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Abstract 

Little  documentation  exists  on  the  role  of  supporting 
commercial  off  the  shelf  (COTS)  systems  bought  by  the  Air 
Force.  Current  USAF  policy  does  not  address  the  dynamic  na¬ 
ture  of  buying  and  supporting  COTS  systems.  The  logistics 
support  challenges  associated  with  COTS  equipment  were  ex¬ 
plored  through  telephone  interviews  with  USAF  managers.  The 
focus  of  this  study  is  on  the  lessons  learned  by  planning 
logistics  support  for  COTS  before,  during,  and  after  the  en¬ 
actment  of  the  Defense  Acquisition  Improvement  Act  of  1986. 
Recommendations  were  made  to  (1>  not  fully  provision  COTS 
programs,  (2)  not  convert  commercial  manuals  to  T.O.s,  (3) 
streamline  the  acquisition  process  for  COTS  systems,  (4)  buy 
COTS  systems  in  larger  quantities  to  enjoy  the  savings  from 
larger  economies  of  scale,  and  <5)  buy  all  engineering  (type 
III)  drawings  when  the  COTS  system  is  integrated  with  GFE 
(such  as  COMSEC  equipment) .N  Recommendations  for  further  re¬ 
search  were  to  (1)  find  COTS  sources  from  foreign  markets  to 
enhance  trade  relationships  with  countries  that  have 
"friendly-nation”  status,  (2)  find  the  practical  methods  to 
streamline  the  USAF’ s  acquisition  and  support  structure  for 
buying  COTS  systems,  and  (3)  identify  all  COTS  programs  that 
have  successfully  satisfied  USAF  mission  requirements  and 
have  met  budget  constraints. 


v 


"Lessons  Learned  from  the  Logistics  Support  for 
Commercial  Off  the  Shelf  U.S.  Air  Force  Equipment" 

I •  Overview 


Introd\ict  ion 

On  15  July  1985,  President  Reagan  appointed  Mr.  David 
Packard  (chief  executive  officer  of  Hewlett-Packard)  to 
chair  the  Blue  Ribbon  Commission  on  Defense  Management  by 
Executive  Order  12526.  This  was  intended  as  a  political 
measure  to  ward  off  Congressional  inquiry  on  recent  Defense 
Department  acquisition  problems.  President  Reagan  primarily 
sought  to  head-off  Congressional  attacks  on  the  Department 
of  Defense  through  the  independent  commission.  At  that 
time,  negative  publicity  about  Defense  acquisition  costs  was 
creating  pressure  within  Congress  to  overhaul  the  current 
acquisition  process.  Representative  William  L.  Dickinson, 
"ranking  Republican  on  the  House  Armed  Services  Committee,” 
had  already  proposed  the  idea  of  the  independent  commission 
in  April  1985  as  an  effort  "to  investigate  alleged  defense 
problems  and  to  coordinate  reform  proposals"  (Heilman: 3, 

Mann: 21).  The  Packard  Commission  finished  its  initial  as¬ 
sessment  by  February  1986  which  was  quickly  accepted  by 
President  Reagan,  and  on  1  April  1986  he  signed  the  National 
Security  Decision  Directive  (NSDD)  219.  NSDD  219  was  Presi¬ 
dent  Reagan’s  approval  of  the  Packard  Commission’s  initial 
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findings.  President  Ronald  Reagan  bad  successfully  defused 
the  "political  confrontation  with  Congress"  over  the  acqui¬ 
sition  problems  in  the  Department  of  Defense  (Heilman: 3-4 ) . 

The  Packard  Commission’s  final  report  (which  was  con¬ 
sistent  with  the  initial  report)  recommended,  that: 

Rather  than  relying  on  excessively  rigid  military 
specifications,  DoD  should  make  greater  use  of  compo¬ 
nents,  systems,  and  services  available  "off-the- 
shelf."  It  should  develop  new  or  custom  made  items 
only  when  it  has  been  established  that  those  readily 
available  are  clearly  inadequate  to  meet  military 
requirements . 

No  matter  how  DoD  improves  its  organization  or  pro¬ 
cedures,  the  defense  acquisition  system  is  unlikely 
to  manufacture  products  as  cheaply  as  the  commercial 
marketplace.  DoD  cannot  duplicate  the  economics  of 
scale  possible  in  products  serving  a  mass  market,  nor 
the  power  of  the  free  market  system  to  select  and  per¬ 
petuate  the  most  innovative  and  efficient  producers. 
When  a  "make  or  buy"  decision  must  be  made,  the  pre¬ 
sumption  should  be  to  buy  (Packard: 60) . 

In  other  words,  the  Packard  Commission  was  proposing  the  De¬ 
partment  of  Defense  buy  more  off-the-shelf  (nondevelopmental 
items)  rather  than  custom  made  (developmental,  MIL-SPEC, 
items)  equipment  and  supplies.  The  President’s  endorsement 
of  these  recommendations  was  accepted  by  Congress  as  the 
measures  needed  to  fix  the  DoD  acquisition  problems.  These 
policies  were  incorporated  into  Public  Law  99-961  under  Sec¬ 
tion  907  titled  ’’Preference  for  Nondevelopmental  Items"  in 
the  Defense  Acquisition  Improvements  Act  of  1966  and  became 
law  on  14  November  1986  (DOD  1987a: 2). 

The  Defense  Acquisition  Improvement  Act  of  1986  changed 
the  DoD’ s  acquisition  policies  significantly  because  it 
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stated  ’’the  Secretary  of  Defense  shall  ensure  that,  to  the 
maximum  extent  practicable,  .  .  . ”  consider  fulfilling  re¬ 

quirements  ’’through  the  procurement  of  nondevelopmental 
items”  <U.S.  Congress: 10  U.S.  Code  2325).  The  Act  defines 
nondevelopmental  items  as  follows: 

(1)  Any  item  of  supply  that  is  available  in  the 
commercial  marketplace; 

(2)  Any  previously-developed  item  of  supply  that  is 
in  use  by  a  department  or  agency  of  the  United  States, 
a  State  or  local  government,  or  a  foreign  government 
with  which  the  United  States  has  a  mutual  defense  co¬ 
operation  agreement; 

<3)  Any  item  of  supply  in  paragraphs  <1>  or  (2>  that 
requires  only  minor  modification  in  order  to  meet  the 
requirements  of  the  procuring  agency;  or 

(4)  Any  item  of  supply  that  is  currently  being  pro¬ 
duced  that  does  not  meet  the  requirements  (1),  (2), 

or  <3>  solely  because  the  item-- 

a.  Is  not  yet  in  use;  or 

b.  Is  not  yet  available  in  the  commercial 
marketplace . 

Additionally,  this  Act  required  the  Secretary  of  Defense  to 
report  actions  taken  to  implement  the  law  within  180  days. 
Hence,  Secretary  of  Defense,  Caspar  Weinberger  appointed  Dr. 
James  R.  Burnett  (Vice  President,  deputy  general  manager  of 
TRW’ s  E&D  Systems  Group  (Marquis:  435))  and  Dr.  William  J. 
Perry  (President  of  H&Q  Technical  Partners,  Incorporated 
(Marquis:  2429))  to  co-chair  the  ”1986  Summer  Study”  of  the 
Defense  Science  Board  to  find  out  how  to  implement  the  new 
law  (DoD  1987b: vli). 
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The  government  uses  the  term  commercial-off-the-shelf 
known  as  COTS.  Commercial-off-the-shelf  (COTS)  items  are 
defined  as  a  subset  of  nondevelopmental  items,  which  do  not 
require  development  by  government  planners.  The  more  accep¬ 
ted  definition  for  COTS  type  equipment  is  as  follows:  ”a 
commercial  item  is  an  item  developed  and  used  for  other  than 
government  purposes;  sold  or  traded  to  the  general  public  li 
the  course  of  normal  business  operations,  and  (ideally)  used 
unchanged  (off-the-shelf)  when  acquired  by  the  government” 
(Sacramento: 1 ) .  The  opposite  of  COTS  type  equipment  is  de¬ 
velopmental  or  MIL-SPEC  systems.  MIL-SPEC  equipment  is  de¬ 
fined  as: 

The  classic  military  approach  to  design  and  construc¬ 
tion:  a  government  design  for  government  use.  The 
Government  is  financing  the  design  effort,  will  ulti¬ 
mately  own  and  control  the  design,  and  intends  that  it 
be  rugged  enough  to  withstand  battlefield  use.  The  de¬ 
sign  philosophy  and  selection  of  parts  are  strictly  ac¬ 
cording  to  military  specifications  and  standards,  and, 
typically,  the  cost  is  high  (Sacramento: 1 ) . 

To  gain  a  further  understanding  of  where  COTS  can  and 
can  not  be  used  in  the  Air  Force,  the  literature  defined 
some  categories  as  unsuitable  for  COTS  acquisition.  Pro¬ 
posals  by  Dr.  Burnett  and  Dr.  Perry  in  the  "Defense  Science 
Board  1986  Summer  Study  oi  Use  of  Co^-mercial  Components  in 
Military  Equipment  clearly  disqualify  certain  military  hard¬ 
ware  for  COTS  acquisition  fitting  into  the  following  cate¬ 
gories:  "nuclear  propulsion,  certain  fuels,  combat  aircraft, 
missile  systems,  explosive  munitions  and  propellants,  de¬ 
structive  weapons,  space  systems,  and  radiation  hard  equip- 
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ment;  commercial  components  and  practices  still  may  be  ap¬ 
plicable”  (DoD  1987b: 17). 

Traditional  lead  times  from  the  conception  phase  to 
production  phase  were  greatly  reduced  with  COTS  acquisitions 
versus  MIL-SPEC  items.  Program  managers  and  logisticia  is 
have  fewer  tasks  to  analyze  with  COTS  systems  because  com¬ 
mercial  systems  are  already  fully  developed,  and  allow  ear¬ 
lier  fielding  times.  Since  COTS  systems  were  in  the  market¬ 
place,  the  Government  did  not  have  to  fund  and  then  wait  for 
the  design  effort  (Sacramento: 3) .  The  reduction  in  lead 
times  for  the  production  phase  for  COTS  systems  often  re¬ 
sults  in  fielding  the  systems  significantly  sooner,  90  days 
to  one  year  versus  three  to  four  years  for  MIL-SPEC  items 
(Teeter  1989a: 1).  This  could  cause  problems  for  Air  Force 
logisticians  because  "the  schedule  of  a  COTS  acquisition  may 
be  so  accelerated  that  the  time  to  complete  the  provisioning 
process  could  very  well  delay  the  deployment  of  the  system” 
(Schumacher: 32)  . 

The  provisioning  process  is  defined  as  follows: 

’’The  process  of  determining  and  acquiring  the  range 
and  quantity  (depth)  of  spares  and  repair  Darts, 
and  support  and  test  equipment  required  to  operate 
and  maintain  an  end  item  of  material  for  an  initial 
period  of  service”  (MI L-STD- 1388- 1 A ) . 

Here-in  lies  the  problem  with  COTS.  COTS  systems  may  be 

fielded  before  their  spare/repair  parts  and  support 
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equipment  are  available.  For  a  COTS  system  to  operate  from 
the  first  day  to  its  expected  failure  point  (mean  time  be¬ 
tween  failure  MTBF) ,  the  Air  Force  must  have  a  preestab¬ 
lished  network  of  repair  and  support  requirements  satisfied. 
This  network  could  simply  be  arrangements  between  the  Air 
Force  and  the  vendor  to  ship  broken  COTS  items  to  the  sup¬ 
plier’s  repair  center  as  part  of  the  warrantee,  and  a  plan 
to  borrow  or  lease  substitutes  until  the  COTS  items  are  re¬ 
turned.  But,  this  simplification  ends  when  the  COTS  items 
are  located  around  the  globe  (as  are  Air  Force  bases)  and 
are  operating  after  the  warrantee  period. 

To  protect  mission  requirements  beyond  the  initial 
fielding  and  warranty  period,  Air  Force  planners  must  use 
more  intense  network  support  plans  such  as  prepositioned 
spare  parts  for  unexpected  breakdowns  and  field  training 
classes  for  new  operators  and  maintainers.  This  planning 
(the  provisioning  process)  may  be  extensive  and  require  time 
horizons  greater  than  six  months  to  interface  the  support 
requirements  to  the  fielded  COTS  system. 

The  provisioning  process  used  to  support  developmental 
items  (MIL-SPEC)  is  comprehensive.  Logisticians  use  an  in¬ 
tegrated  logistics  support  (ILS)  approach  to  study  the  im¬ 
pacts  of  support  re  jirements  on  the  life  cycle  cost  and 
readiness  for  proposed  MIL-SPEC  acquisitions.  ILS  develop¬ 
ment  may  take  up  to  five  years  for  new  systems  (ILS  Support 
Guide: 4-5).  ILS  development  time  greater  than  one  year  is 
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not  adequate  for  COTS  systems  that  can  be  acquired  in  90 
days  to  one  year.  If  logisticians  use  the  same  planning 
horizons  and  techniques  for  COTS  items  that  they  currently 
use  to  plan  support  for  MIL-SPEC  items,  then  logisticians 
will  need  more  time  to  plan  and  acquire  logistics  support 
for  COTS  items. 

Before  the  buying  can  begin,  all  of  the  logistics  sup¬ 
port  areas  for  COTS  systems  must  be  assessed.  Without  lo¬ 
gistics  support,  a  COTS  system  may  not  be  supportable  be¬ 
yond  its  warranty  period.  Therefore,  the  logistics  support 
planning  requirements  for  COTS  systems  are  identical  to  the 
planning  requirements  for  MIL-SPEC  systems  and  must  be  fin¬ 
ished  before  buying  the  COTS  system.  Examples  of  planning 
requirements  include  providing  maintenance,  spare  parts,  fa¬ 
cilities,  support  equipment,  technical  publications,  compu¬ 
ter  support,  packaging,  storage,  handling,  and  transporta¬ 
tion.  These  planning  requirements  must  be  evaluated  for  the 
system’s  entire  useful  life.  In  some  cases,  the  first  to 
the  last  day  of  operation  could  span  more  than  a  decade. 

However,  the  shortened  acquisition  cycle  for  COTS  sys¬ 
tems  and  the  peculiarities  of  commercial  systems  often  cause 
significant  hurdles  for  DoD  logistics  planners.  Since  the 
procurement  lead  times  take  as  long  as  three  to  four  years 
for  MIL-SPEC  systems,  logisticians  have  two  or  three  years 
to  develop  comprehensive  Integrated  Logistics  Support  Plans. 
The  meticulous  detail  needed  to  plan  integrated  logistics 
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support  for  MIL-SPEC  systems  is  no  different  for  COTS  sys¬ 
tems.  The  same  issues  logisticians  address  while  evaluating 
developmental  items  must  also  be  evaluated  when  considering 
COTS  systems,  and  the  time  element  available  to  MIL-SPEC 
items  is  not  available  for  COTS  items.  Support  requirements 
can  not  simply  be  neglected  in  order  to  save  time  when 
fielding  new  COTS  systems  because  the  acquisition  time  may 
be  reduced  from  three  to  four  years  to  as  little  as  90  days. 

Purpose 

The  purpose  of  this  research  thesis  will  be  to  explore 
the  logistics  support  challenges  that  Air  Force  logisticians 
face  when  working  with  COTS  equipment,  and  to  investigate 
the  lessons  they  learned  by  planning  the  support  for  COTS 
equipment/systems  before,  during,  and  after  the  enactment  of 
the  Defense  Acquisition  Improvement  Act  of  1986. 

Specific  Problem 

Current  Air  Force  policy  on  logistics  support  does  not 
address  the  dynamic  nature  of  buying  and  supporting  COTS 
systems.  This  lack  of  policy  has  created  a  need  for  guid¬ 
ance  to  buy  and  support  COTS  systems.  As  the  trend  towards 
commercial  buying  increases  in  the  DoD,  this  policy  short¬ 
fall  will  become  more  acute  to  our  Air  Force  logisticians. 

Many  logisticians  plan  the  support  packages  for  COTS 
systems  for  the  Air  Force  based  upon  older  policy  directives 
written  around  systems  and  major  pieces  of  equipment 
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peculiar  to  the  MIL-SPEC  development  process.  Since  the 
Defense  Acquisition  Improvement  Act.  for  1986,  some  guidance 
has  been  provided  in  ’’The  COTS  Book”  distributed  by  the 
Sacramento  Acquisition  Logistics  Center  (Sacramento)  to 
logisticians  in  the  Air  Force  Communications  Command  (AFCC), 
Air  Force  Logistics  Command  (AFLC) ,  and  Air  F  rce  Systems 
Command  (AFSC) .  Continuing  difficulties  in  the  support  of 
COTS  systems  have  drawn  the  attention  of  both  commanders  of 
AFLC  and  AFSC  (Teeter,  1989a:  1-2).  During  the  22-23  March 

1989  AFSC/AFLC  Joint  Commanders’  Conference  held  at  Vright- 
Patterson  AFB,  Generals  Alfred  G.  Hansen  (Commander  of  AFLC) 
and  Bernard  P.  Randolph  (Commander  of  AFSC)  agreed  to  estab¬ 
lish  a  working  group  to  develop  policies  and  procedures  for 
determining  COTS  requirements  and  the  resulting  acquisition 
and  support  decisions  (Hansen: 1).  The  working  group  was  to 
be  led  by  Mr.  Richard  Bleau  a  senior  logistician  at  Electro¬ 
nic  Systems  Division  (ESD/PLL) ,  Hanscom  AFB  MA  and  was  di¬ 
rected  (tasked)  to  do  the  following  (Hansen: 1): 

Develop  a  draft  charter  for  approval  by  HQ  AFSC/PL,  HQ 
AFLC/MM,  AFCC/CV  and  ALD/CC. 

Notify  appropriate  commands  and  organizations  to  iden¬ 
tify  working  group  members. 

Assemble  the  COTS  working  group  and  complete  the  study 
after  approval  of  the  charter. 

Report  findings  and  recommendations  to  the  first  AFSC/ 
AFLC  Joint  Commanders’  Conference,  which  occurs  after 
completion  of  the  study,  for  inclusion  as  Air  Force 
pol icy . 
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One  of  the  primary  COTS  logistics  support  objectives  is  to 
get  logistics  support  strategies  up  front  as  early  as  pos¬ 
sible  (Bleau) . 

Investigative  Questions 

To  focus  this  research,  the  following  questions  will  be 
used  to  guide  the  investigation: 

1.  Vhat.  impact  does  the  new  acquisition  initiatives 
created  by  the  Defense  Acquisition  Improvement  Act  of  1986 
have  on  the  current  logistics  planning  process  for  Air  Force 
COTS  systems? 

2.  How  have  Air  Force  logisticians  adapted  to  shorter 
acquisition  cycles  for  COTS  systems  and  equipment? 

3.  Vhat  creative  techniques  have  logisticians  used  to 
protect  the  Government’s  <DoD  and  U.S.  Air  Force)  operations 
from  COTS  systems  that  become  prematurely  obsolescent  and 
retired  for  use  by  the  Air  Force? 

4.  Vhat  kind  of  Air  Force  missions  are  best  suited  to 
use  and  support  COTS  equipment? 

5.  Vhat  have  Air  Farce  acquisition  and  logistics  man¬ 
agers  done  to  maximise  the  benefits  of  COTS  systems  and  to 
minimize  any  other  risks  associated  with  buying  and  sup¬ 
porting  these  systems? 

Scope 

The  central  theme  of  •'■his  research  is  to  identify  les¬ 
sons  learned  and  to  identify  trends  in  buying  and  supporting 
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COTS  equipment  and  systems  that  will  be  useful  to  logisti¬ 
cians  throughout  the  Air  Force  who  may  buy  future  COTS  sys¬ 
tems.  The  Air  Force  has  bought  many  types  of  COTS  systems 
over  the  years  such  as  computers,  test  equipment,  radios, 
ground  electronics,  audio  visual,  vehicles,  and  aircraft. 
Within  the  Air  Force  there  are  logisticians  who  have  the 
"corporate  memory"  of  the  intracies  of  supporting  COTS  sys¬ 
tems.  By  tapping  the  information  from  these  corporate  ex¬ 
perts,  one  can  expect  to  uncover  techniques  and  lessons 
learned  from  buying  and  supporting  Air  Force  COTS  systems. 
This  information  may  be  used  as  a  foundation  to  formulate 
current  logistics  support  policy  for  COTS  systems. 

To  get  a  better  idea  how  different  Air  Force  managers 
approach  individual  peculiarities  with  COTS  acquisitions, 
this  research  will  seek  out  and  interview  these  experts  who 
have  supported  a  variety  of  COTS  systems  located  at  various 
Air  Force  agencies.  This  will  enable  the  researcher  to  stu¬ 
dy  a  variety  of  management  styles  and  different  logistics 
operat i ons . 

The  primary  focus  of  this  research  thesis  will  be  to 
identify  the  management  techniques  used  by  Air  Force  logis¬ 
ticians  who  deal  with  COTS  items.  As  more  COTS  systems  are 
purchased  in  the  Air  Force,  managers  will  become  challenged 
to  find  information  that,  will  help  them  solve  support  pro¬ 
blems  specially  related  to  COTS  systems.  The  management 
techniques  documented  by  this  thesis  may  provide  a  useful 
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basis  of  information  to  future  logisticians  who  will  buy 
COTS  items  for  the  Air  Force. 

Conclusion 

COTS  supportabi 1 ity  issues  have  drawn  the  attention  of 
the  Commanders  of  AFLC  and  AFSC.  By  looking  at  a  combina¬ 
tion  of  equipments  and  management  techniques  used  to  support 
COTS  systems  used  by  the  Air  Force,  this  paper  will  identify 
the  central  points  of  lessons  learned  and  current  trends 
that  may  be  used  in  the  future  to  acquire  newer  COTS  systems. 
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I  I  .  Literature  Review 


What  is  COTS? 

An  explanation  of  commercial-off-the-shelf  (COTS) 
equipment  may  be  described  best  by  relating  it  in  terms  of 
the  consumer  who  uses  the  system  or  equipment.  When  consu¬ 
mers  are  ready  to  buy  a  product  or  service  they  need,  they 
go  to  a  store  or  vendor  who  can  supply  the  product  or  ser¬ 
vice.  The  vendor  or  store  is  open  to  the  general  public  and 
sells  its  wares  on  the  open  market.  The  wares  or  services 
are  mass  marketed  in  some  kind  of  store  display  or  picture 
in  a  catalog  available  to  shopping  consumers.  When  the  ven¬ 
dor  makes  a  product  or  service  that  fits  the  needs  of  consu¬ 
mers  at  an  affordable  price,  the  business  can  expect  a  sales 
transaction  with  its  customers.  When  items  do  not  satisfy 
the  consumer’s  needs,  the  products  lose  their  value  to  cus¬ 
tomers  and  the  vendor  eventually  pulls  products  off-the- 
shelve  and  replaces  the  products  with  more  appealing  (need¬ 
ed)  wares. 

One  important  point  to  make  here  is  that  the  consumer 
makes  no  attempt  to  change  the  product  design  to  fit  it  to 
special  or  unusual  requirements  (such  as  military  use).  The 
company  does  not  have  any  contact  with  the  consumer  except 
through  the  store  that  sells  its  products.  The  customer  has 
no  input  to  the  company  other  than  by  the  purchasing  ’’vote”. 
Consumer  demand  is  the  direct  message  that  is  sent  back  to 
the  manufacturing  firm  who  redesigns  or  discontinues  the 
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prodtict.  or  offers  substitutes  to  satisfy  the  changing  market 
needs  in  order  to  stay  in  business.  Commercial  products  un¬ 
dergo  this  continuous  change  to  allow  vendors  to  maintain 
profits,  Unlike  custom  products  which  are  designed  for  a 
special  customer,  commercial  products  are  designed  for  gen¬ 
eral  public  use.  The  public  does  not  tell  the  producer  how 
to  make  the  product,  ask  for  the  design  plans,  spare  parts, 
or  for  guarantees  that  the  product  will  remain  unchanged 
indefinitely  <i.e.  10  to  20  years  as  do  U.S.  Air  Force  lo¬ 

gisticians  do  with  MIL-SPEC  products). 

COTS  equipment  is  that  type  of  equipment  purchased  by 
public  consumers  for  use  in  their  homes,  non-for-profit 
organizations,  and  businesses.  No  modifications  are  re¬ 
quired  by  the  customer.  The  product  is  bought  as-is  off  of 
the  vendor’s  store  shelf.  The  product  is  strictly  intended 
for  civilian  use  (Sacramento: 2) .  The  military  is  making  ex¬ 
panded  use  of  commercial  equipment  which  could  present  some 
problems.  Commercial  equipment  may  or  may  not  be  able  to 
withstand  battlefield  use  or  the  rugged  requirements  for 
military  use.  In  addition,  support  issues  for  COTS  items 
must  be  fully  evaluated  to  insure  that  COTS  items  will  suit 
the  mission  requirements  of  a  defined  need. 

Logistics  Support  for  Commercial  Of f-the-Shelf  (COTS) 

Def ined . 

Since  COTS  equipment  is  easily  accessible  in  the  ci¬ 
vilian  marketplace,  the  buying  process  appears  to  be  easier 
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than  buying  MIL-SPEC  items  because  there  is  no  detailed  de¬ 
sign  requirements  (Sacramento : 3 ) .  Buying  COTS  is  popular 
for  several  other  reasons.  Cumbersome  contracting  paperwork 
requirements  for  developmental  items  may  be  eliminated  that 
’’drive  away  many  of  the  best  and  technologically  advanced 
suppliers”  (Cohen: 11).  The  service  can  also  reduce  the 
’’cost  of  doing  business  with  the  government  so  that  the  go¬ 
vernment  can  accrue  the  advantages  of  lower  cost  and  better 
products  more  often”  (Cohen: 11).  Another  reason  COTS  sys¬ 
tems  may  be  considered  is  that  the  government  can  ’’reduce 
development  and  procurement  lead  times  by  using  existing 
commercial  products  more  often”  (Cohen: 11).  U.S.  Air  Force 
managers  may  feel  pressured  at  the  end  of  the  fiscal  year  to 
spend  uncommitted  funds  on  easy  to  buy  COTS  equipment  so 
Congress  can  be  shown  they  are, responsible  by  spending  their 
programmed  funds.  Buying  COTS  equipment  without  considering 
the  logistics  support,  as  in  the  cases  mentioned  above,  can 
be  disastrous. 

Should  Air  Force  managers  and  users  be  able  to  identify 
COTS  equipment,  which  may  satisfy  a  need  or  mission,  without 
considering  the  impact  of  the  logistics  support  costs? 

There  may  be  temptations  to  buy  COTS  equipment  immediately 
if  funds  are  available.  This  can  be  hazardous  and  faulty 
especially  if  the  manager  fails  to  analyze  the  full  impacts 
of  logistics  support.  According  to  Heilman,  ’’commercial 
manufacturers  are  seldom  concerned  with  military-style 
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configuration  management”  (He i lman : 26 > .  This  is  not  the 
only  concern  with  logistics  support  for  COTS  equipment. 

When  COTS  equipment  is  purchased,  the  manager  gives  up  the 
right  to  access  the  design  because  the  producer  retains  ex¬ 
clusive  design  rights  guaranteed  by  U.S.  trademark  and  pat¬ 
ent  laws.  The  manager  also  buys  into  the  producer's  support 
scheme  which  may  have  any  number  of  options  ranging  from  no 
support  (i.e.  disposable  items)  to  factory  maintenance  and 
training.  The  manager  also  forfeits  control  over  future 
modifications  the  producer  may  impose  to  satisfy  public/ci¬ 
vilian  market  demands.  So,  the  simple  COTS  purchase  origi¬ 
nally  considered  by  an  Air  Force  manager  or  user  can  have 
detrimental  mission  impacts  if  these  support  peculiarities 
are  not  considered  before  the  request  for  proposal  (RFP)  is 
published  in  the  Commerce  Business  Daily. 

When  the  Air  Force  manager  gives  up  the  right  to  access 
the  equipment  design,  the  risks  to  use  COTS  increase  signif¬ 
icantly.  For  example,  if  the  producer  goes  out  of  business 
or  quits  making  the  COTS  equipment  before  the  end  of  the 
equipment’s  useful  life,  the  fielded  systems  could  become 
prematurely  obsolete  or  retired  early  because  spare  parts 
will  no  longer  be  made  or  stocked  by  the  company.  Should 
the  Air  Force  manager  fail  to  fully  assess  the  impact  of  the 
maintenance  or  service  plan  for  the  COTS  equipment  under 
consideration,  the  hidden  or  unexpected  costs  to  keep  the 
system  operational  may  arise  beyond  expected  life  cycle 
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costs.  For  example,  the  producer  could  change  the  product 
design  after  the  Air  Force  buys  COTS.  The  repair  parts  may 
become  incompatible  as  a  result  of  the  design  change  which 
could  result  in  special  and/or  expensive  design  interfaces 
to  fix  older  fielded  systems,  or  worse,  the  broken  fielded 
system  may  be  retired  early. 

These  constraints  point  out  the  negative  support  issues 
of  buying  COTS.  The  positive  issues  must  also  be  discussed 
to  fully  define  logistics  support  for  COTS  equipment.  When 
a  need  is  identified,  funds  are  available,  and  Air  Force 
managers  decide  they  can  live  with  the  uncertainties  of  the 
support  issues  of  COTS,  the  Air  Force  does  not  have  to  fund 
and  wait  for  the  design  effort,  and  as  a  result,  the  Air 
Force  can 'get  an  advanced  product  cheaper  and  faster  (Sacra¬ 
mento:  3).  Other  positive  advantages  include:  current  and 
advancing  technologies,  market  based  pricing,  up  front 
product  identification  and  pricing,  proven  performance  and 
reliability,  and  an  existing  support  structure  (Schumacher: 
24).  This  whole  positive  issue  is  what  the  Packard  Commis¬ 
sion  felt  the  DoD  needed  to  do  to  cut  costs  (Packard :  60 )  . 

When  defining  logistics  support  issues  for  any  new  Air 
Force  system,  the  Air  Force  logistics  planner  is  reminded  of 
the  acquisition  logistics  process  in  AFLC/AFSC  Pamphlet 
800-34 : 

The  process  of  systematically  identifying  and  assessing 
logistics  alternatives,  analyzing  logistics  alterna¬ 
tives,  analyzing  and  resolving  I LS  (integrated  logis¬ 
tics  support)  deficiencies,  and  managing  ILS  throughout 
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the  acquisition  process  (Department  of  the  Air  Force 
Pamphlet  800-34:1-1). 

Traditional  developmental  items  (MIL-SPEC,  such  as  the 
F-16  fighter  aircraft)  require  intensive  acquisition  logis¬ 
tics  management  throughout  the  life  of  the  system.  The  four 
key  parts  of  acquisition  logistics  are:  "the  concept  of  life 
cycle  cost  (LCC) ;  integrated  logistics  support  and  the  (ten) 
ILS  elements;  integrated  logistics  support  planning;  and  lo¬ 
gistics  support  analysis"  (Materna : 5- 1 ) .  According  to  Mr. 
Lyle  Teeter  (senior  logistician  at  HQ  Air  Force  Communica¬ 
tions  Command  (AFCC) : 

The  whole  process  was  designed  for  research  and  devel¬ 
opment  programs  where  the  time  span  of  the  acquisition 
process  allows  for  development  of  the  logistics  support 
to  mature  with  the  equipment  acquisition. 

(Teeter  1989a: 1) 

Since  COTS  systems/equipment  are  brought  on-line  much  sooner 
(90  days  to  one  year  at  HQ  AFCC) ,  "most  COTS  systems  arrive 
in  the  field  without  proper  logistics  support,  regardless  of 
(the)  purchasing  agency”  (Teeter  1989a: 1). 

Logistics  Support  Policy 

Current  DoD  and  Air  Force  policy  on  COTS  is  seen  by 
logisticians  in  the  Air  Force  as  "good,  but  do  not  go  deep 
enough  into  the  support  area"  (Teeter  1989a: 1).  The  two 
most  recent  publications  giving  guidance  on  acquiring  COTS 
are  "The  COTS  Book"  produced  by  Sacramento  ALC  and  DoD  Di¬ 
rective  5000.37  (DoD  1988: 1-6).  Vith  the  increasing  trend 
towards  buying  commercial  products  to  satisfy  some  Air  Force 
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missions,  the  program  manager  or  logistician  will  have  to 
"factor-in  very  authoritative  configuration  control  to  his 
Nondeve 1 opmenta 1  Item  NDI/  (COTS)  negotiations.  The  bottom 
line  then  is  that  we  must  take  advantage  of  NDI/(COTS),  but 
proceed  carefully  in  the  high  tech  areas  when  systems  are 
not  able  to  stand  alone”  (Feder: 18).  Mr.  Teeter  (AFCC/LG) , 
states  "we  need  standard  operating  procedures  for  the  de¬ 
velopment  of  logistics  support  for  COTS  programs,”  .... 
and  ”we  need  an  Air  Force  level  look  at.  the  whole  process  to 
uncover  the  real  problems,  and  build  some  fixes”  (Teeter 
1989a: 2) . 

Conclusion 

Almost  any  item  used  i n ■ non-war f are  missions  may  be 
considered  a  COTS  candidate  according  to  the  Defense  Science 
Board  1986  Summer  'Study.  The  trend  in  DoD  acquisition  will 
begin  to  lean  towards  buying  more  commercial  products  and 
services.  Already  HQ  AFCC  is  buying  most  of  their  communi¬ 
cations  systems  (such  as  BIDDS,  Fed  Switch,  and  BISS/ESC) 
off-the-shelf  (Teeter  1989a: 1,  Clark  1990).  The  challenging 
hurdles  for  Air  Force  logisticians  will  be  to  cope  with  a 
number  of  support  issues  when  considering  a  COTS  acquisi¬ 
tion.  Air  Force  policy  on  logistics  support  for  COTS  sys¬ 
tems/equipment  is  shallow  and  currently  undergoing  review 
and  development  in  the  COTS  working  group  at  ESD  Hanscom 
AFB,  MA  (HQ  AFCC/AFLC/AFSC: V) .  The  Air  Force  recognizes  its 
shortcomings,  yet  the  COTS  acquisition  and  logistics  support 
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contracts  continue  to  be  awarded  for  new  test  equipment, 
aircraft,  vehicles,  etc.  The  body  of  knowledge  exists  in 
the  Air  Force  now  that  can  resolve  many  of  the  negative  lo¬ 
gistics  support  issues  for  future  COTS  systems.  Section  III 
will  describe  the  method  to  gather  the  techniques  used  by 
Air  Force  logisticians  who  plan  support  for  COTS  equipment 
on  a  day-to-day  basis. 
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III.  Methodology 


Overview 

The  purpose  of  this  research  thesis  was  to  explore  the 
challenges  in  supporting  commercial-off-the-shelf  (COTS) 
systems  and  to  obtain  practical  lessons  learned  from  Air 
Force  logisticians  who  supported  COTS  systems  after  the  De¬ 
fense  Acquisition  Improvement  Act  of  1986.  This  research 
study  will  build  a  foundation  for  literature  on  buying  and 
supporting  COTS  systems.  This  study  may  also  be  used  by  lo¬ 
gisticians  who  want  to  discover  how  other  logisticians  sup¬ 
port  different  kinds  of  COTS  systems,  and  the  study  may  en¬ 
courage  a  cross  exchange  of  ideas  between  the  Air  Force  lo¬ 
gistics  community  to  improve  the  techniques  needed  to  buy 
and  support  these  systems.  Another  use  of  the  study  may  be 
to  encourage  improvements  in  official  Air  Force  acquisition 
and  logistics  policies  through  ad  hoc  committees  for  COTS 
systems . 

Construction  of  the  Questionnaire 

The  descriptive  nature  of  this  study  lent  itself  to¬ 
wards  obtaining  logistics  managers’  opinions  on  how  to  sup¬ 
port  COTS  systems  in  a  dynamic  environment.  The  choice  for 
collecting  this  descriptive  information  was  either  a  ques¬ 
tionnaire  designed  for  a  mailed  survey  or  a  telephone  (or 
personal)  interview.  The  telephone  interview  presented  the 
best  alternative  to  collect  the  primary  data  for  this 
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research  thesis  because  the  survey  had  the  potential  of 
non-response,  and  respondents  were  geographically  separated 
at  many  locations  around  the  United  States.  Even  though  the 
survey  was  cheaper  to  conduct  and  was  more  efficient  than 
the  telephone  interview,  the  telephone  interview  allowed  the 
researcher  to  ask  probing  questions  from  the  respondents. 
Quality  results  were  important  because  this  studv  was  estab¬ 
lishing  initial  findings.  The  possible  non-response  from 
the  survey  technique  could  have  jeopardized  the  study  if  the 
minimum  sample  size  was  not  met. 

There  were  also  limitations  considered  when  using  the 
telephone  interview  technique  for  this  research  study. 

1.  The  respondent  had  to  be  available. 

2.  There  was  a  possibility  that  the  respondent  had 
moved  to  a  new  location  that  was  different  than  the 
published  number. 

.  3.  The  length  of  the  interview  was  limited  by  the 
respondent’s  interest  in  the  subject. 

4.  It  was  not  possible  to  use  illustrations  over  the 
phone  to  further  clarify  questions  by  the  interviewer. 

5.  Studies  have  shown  that  it  has  been  easy  for  the 
respondent  to  terminate  an  interview  early. 

(Emory:  170-1) 

The  initial  questionnaire  was  developed  to  make  the 
telephone  interview  interesting  to  the  candidate  by  asking 
how  candidates  managed  their  programs.  The  questionnaire 
was  also  designed  to  be  short  (no  longer  than  30  minutes)  to 
invite  participation  from  these  extremely  busy  managers. 
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To  increase  the  efficiency  and  validity  of  the  draft 
telephone  questionnaire,  it  was  presented  to  Ms.  Maryanne 
Marshall,  an  acquisition  logistics  management  specialist  at 
HQ  ESD/ALL  who  was  developing  COTS  logistics  support  poli¬ 
cies  for  the  Air  Force  (Marshall:  1990).  Ms.  Marshall 
thought  the  draft  questionnaire  was  too  specific  and  not 
broad  enough  to  encourage  an  open  dialog  for  telephone  in¬ 
terviews  (her  suggestions  were  incorporated  into  the  final 
version) .  The  15  questions  used  in  the  questionnaire  con¬ 
tained  ideas  that  were  considered  to  be  the  primary  logis¬ 
tics  support  processes  for  COTS  systems  by  Ms.  Marshall  and 
the  researcher  (see  Attachment  A) .  These  questions  also 
were  designed  to  explore  the  management  techniques  currently 
used  by  Air  Force  logisticians  who  buy  and  support  COTS 
systems. 

Locating  Logisticians  Who  Support  COTS 

Interviewing  the  logisticians  who  support  COTS  systems 
presented  a  significant  challenge  for  two  reasons.  First, 
the  Air  Force  supports  COTS  systems  from  many  bases  around 
the  continental  U.S.  (CONUS),  and  the  personal  interview 
technique  required  travel  funds  during  a  period  of  budget 
reductions.  Second,  the  time  required  to  travel  to  all  lo¬ 
cations  to  conduct  the  personal  interviews  did  not  fit  with¬ 
in  the  research  time  schedule. 
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Data  Collection 


The  telephone  interview  was  selected  over  the  personal 
interview  because  of  the  problems  of  traveling  to  the  mana¬ 
gers’  work  place.  To  minimized  the  problem  with  respondent 
availability,  logistics  managers  were  located  by  contacting 
the  HQ  AFLC  Logistics  Operations  Center  (LOC)  at  Vright- 
Patterson  AFB,  OH.  The  criterion  for  COTS  systems  (as  de¬ 
scribed  in  the  DSB  Summer  Study  of  1986)  were  described  to 
LOC  personnel  to  locate  logistics  directorates  around  the 
Air  Force  that  managed  possible  off-the-shelf  programs. 

Once  directorates  were  contacted,  a  list  of  candidates  was 
secured,  and  the  focus  changed  to  the  interview  process. 

Interview  Process 

Before  the  interview  process  could  begin,  each  of  the 
candidates  had  to  be  contacted  to  solicit  their  participa¬ 
tion  in  the  research  effort.  To  reduce  the  risk  of  early 
terminations  by  respondents  during  the  telephone  interview, 
the  respondents  were  told  that  advanced  copies  would  be 
mailed  to  further  speed  the  interview  process.  Another 
reason  for  the  advanced  mailing  was  to  allow  managers  time 
to  collect  their  thoughts  before  the  interview  began  and  to 
incite  a  feeling  that  the  interviewer  cared  about  the  mana¬ 
ger’s  available  time.  A  third  reason  for  the  advanced  mail¬ 
ing  was  to  serve  as  a  reminder  to  the  manager  that  they  were 
part  of  an  important  research  study  that  required  their  ex¬ 
pert  knowledge.  The  fourth  reason  served  as  a  reminder  to 
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the  respondents  that  they  had  an  appointment  with  the  inter¬ 
viewer  on  their  COTS  system. 

Each  respondent  was  told  they  would  be  contacted  within 
ten  working  days  to  schedule  an  appointment  for  the  inter¬ 
view.  The  ten  days  between  the  solicitation  call  and  the 
follow-up  c»U  allowed  the  Air  Force  and  the  Postal  Service 
time  to  get  the  advanced  copies  of  the  questionnaire  to  the 
respondents  through  the  Air  Force’s  base  distribution  system 
and  time  for  the  respondents  to  review  the  questions.  Dur¬ 
ing  the  follow-up  call,  the  respondents  were  asked  if  they 
had  reviewed  the  questionnaire.  After  the  respondents  af¬ 
firmed  they  had  had  time  to  review  the  questionnaire,  they 
were  asked  for  an  interview  appointment  that  best  fit  their 
schedule.  This  adaptive  flexibility  further  enhanced  the 
relationship  between  the  respondent  and  the  researcher  to 
increase  the  probability  that  the  respondent  would  partici¬ 
pate  in  the  research. 

Sampling  Size 

The  focus  of  this  research  was  on  the  experts  who  were 
working  with  logistics  support  for  COTS  systems.  Purposive 
sampling  was  used  to  gather  the  primary  data  for  the  anal¬ 
ysis  (Section  IV).  Purposive  sampling  is  nonprobabl i st i c  in 
nature  but  conforms  to  certain  criteria  (Emory:  280 ' 
Judgement  sampling  was  the  primary  purposive  sampling  tech¬ 
nique  used  to  select  the  experts  who  worked  with  COTS 
logistics  support.  Judgement  sampling  allowed  the 
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researcher  ho  selectively  choose  sample  members  who  con¬ 
formed  to  some  criterion  < Emory : 280 ) .  The  criterion  used  to 
handpick  the  sample  members  was  based  on  the  range  of 
available  C0T3  systems  described  in  Section  II. 

Sampling  size  for  nonprobabi 1 ist ic  samples  can  be  deba¬ 
table.  For  probabilistic  research  studies,  the  researcher 
can  use  statistical  calculations  to  back  into  the  sample 
size  by  estimating  the  size  of  the  population  for  a  desired 
confidence  interval  with  a  certain  level  of  significance. 
With  nonprobabal ist ic  research,  the  researcher  may  not  use 
traditional  stochastic  methods  because  the  true  cross  sec¬ 
tion  is  not  the  aim  of  the  research  (Emory.  303).  Since 
this  study  was  exploratory  in  nature  and  focused  on  a  spe¬ 
cific  criterion-based  study  that  used  nonpr obabi 1 i st ic 
judgement  sampling,  the  sample  size  had  to  be  representative 
of  the  experts’  opinions  who  were  managing  logistics  support 
for  COTS.  The  researcher  decided  at  least  ten  experts  were 
needed  to  gain  a  useful  insight  on  the  methods  used  to  man¬ 
age  logistics  support  for  COTS  systems. 

Assumptions  and  Limitations 

The  danger  of  nonpr obabi 1 i st ic  sampling  occurs  when  the 
researcher  and  reader  make  generalizations  that  go  beyond 
the  scope  of  the  COTS  systems  sampled.  This  research  study 
was  designed  to  be  an  exploratory  study  that  will  build  a 
foundation  for  lessons  learned  about  logistics  support  for 
COTS  systems.  Additional  research  will  be  required  on  COTS 
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systems  outside  those  sampled  for  the  reader  to  make  strong¬ 
er  generalizations  about  how  to  support  other  types  of  COTS. 

Sample  COTS  Systems 

At  least  ten  systems  at  different  locations  had  to  be 
studied  to  insure  the  sample  size  for  the  research  was  ade¬ 
quate  to  draw  conclusions.  The  following  list  of  equipments 
were  identified  to  be  used  in  the  research  thesis: 


a  ) 

CCSS/Red  Switch 

electronic 

b) 

GTE/Red  Switch 

electronic 

c ) 

2246A  Oscilloscope 

test  equipment 

d) 

5100B  Meter  Calibrator 

test  equipment 

e) 

C-21  A 

aircraft 

f ) 

Front-end  Loader 

construction  eq 

8> 

C-20  A 

aircraft 

h) 

CID#31  Signal  Generator 

test  equipment 

i  ) 

1/2  Ton  Pickup  Truck 

vehicle 

j  > 

Snow  Blower 

construction  eq 

k) 

Sentinel  Bright  I  I 

computer 

1) 

Scope  Shield/LMR 

electronic 

ra) 

CCPDSR 

computer 

n ) 

Granite  Sentry 

computer 

o) 

PCCIE 

power  equipment 

P> 

Sent inel- Aspen 

computer 

q> 

21  Victor 

computer 
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Analysis  Methodology 


The  questionnaire  was  designed  to  start  each  interview 
with  generally  broad  questions  that  eased  the  interviewee 
into  more  specific  areas  about  their  COTS  system.  Question 
1  was  designed  to  get  the  basic  facts  about  how  the  system 
worked,  who  used  it,  and  where  the  system  was  operating. 
Question  2  sought  out  to  insure  that  the  COTS  system  was 
pure  COTS  or  modified  COTS.  By  differentiating  the  system, 
the  researcher  was  insuring  the  interviewee  did  not  provide 
iniormation  on  a  MIL-SPEC  system.  If  the  modification  was 
significant,  then  the  modified  COTS  system  was  beginning  to 
fit  the  qualifications  of  a  developmental  system  (Sacramen¬ 
to:  1)  . 

After  the  system  was  identified  as  being  a  modified  or 
pure  off-the-shelf  item,  the  researcher  posed  question  3  to 
identify  the  maintenance  concept  to  determine  if  the  equip¬ 
ment  was  to  be  repaired  in-house  or  by  a  contractor.  The 
Air  Force’s  maintenance  concept  uses  either  in-house  person¬ 
nel  and  support  equipment  (organic)  or  contractors  (contrac¬ 
tor  logistics  suppport,  CLS)  to  repair  and  maintain  COTS 
systems.  Organic  maintenance  is  defined  as  the  in-house 
capabilities  of  the  Air  Force  to  service  the  system  with 
current  facilities  and  staffing  personnel.  Contractor  Lo¬ 
gistics  Support  (CLS)  is  defined  as  the  total  maintenance 
and  supply  support  effort  by  a  vendor  for  the  COTS  system. 
The  purpose  of  question  3  was  to  identify  the  special 
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requirements  of  contracting  out  CLS  for  the  COTS  system. 
Organic  maintenance  capabilities  are  predictable  and  gov¬ 
erned  specifically  in  the  66  series  Air  Force  Regulations. 
Whereas  CLS  may  operate  under  factory  authorized  instruc¬ 
tions.  Question  4  fallowed  question  3  to  allow  the  logisti¬ 
cian  to  tell  how  the  maintenance  concept  affected  the  mis¬ 
sion  capability  of  the  COTS  system. 

Question  5  asked  the  logistician  to  discuss  in  detail 
how  drawings  and  manuals  affected  the  mission  capability  of 
the  COTS  system.  Additional  information  was  needed  within 
this  question  to  further  clarify  issues  that  may  have  had 
either  an  adverse  impact  or  significant  improvement  on  the 
mission  of  the  COTS  system.  Question  6  was  designed  to 
identify  whether  the  COTS  system  was  being  used  as  a  stand 
alone  system  or  as  part  of  another  larger  system.  The 
researcher  also  sought  to  identify  critical  mission  impair¬ 
ments  or  significant  improvements  caused  by  incorporating 
the  COTS  system  into  another  system  or  facility  with  ques¬ 
tion  6. 

Question  7  addressed  the  training  issues  that  were 
required  by  personnel  who  operated  and  supported  the  COTS 
system.  Question  8  covered  the  very  important  issue  about 
the  spare  parts  for  the  COTS  system.  Question  9  was  a 
follow-on  to  question  8  as  it  linked  spare  parts  to  config¬ 
uration  management  and  control  of  the  COTS  system. 
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Question  10  allowed  logisticians  to  state  how  they  adapted 
to  configuration  changes  in  the  COTS  system. 

Question  11  was  designed  to  be  a  general  question  that 
polled  the  logistician  for  support  problems  that  may  have 
impacted  the  capabilities  of  the  COTS  system.  Next,  the 
researcher  allowed  the  logistician  to  use  creative  thinking 
to  identify  changes  to  improve  the  COTS  system  in  question 
12. 

Question  13  was  straight  forward  in  that  it  sought  the 
expert’s  opinion  of  whether  the  Air  Force  made  a  good  pur¬ 
chase  in  the  specific  COTS  system.  Question  14  allowed  the 
logistician  to  identify  any  other  features,  benefits,  or 
problems  that  were  not  previously  discussed  in  the  inter¬ 
view.  Finally,  question  15  addressed  specifically  how  the 
budget  and  manpower  cuts  would  affect  the  COTS  system.  The 
results  from  the  final  question  is  extremely  important  to 
future  Air  Force  logisticians  who  must  face  impinging  budget 
cuts  such  as  in  the  early  1990s. 

Conclusion 

The  management  styles  and  techniques  were  gathered  by 
telephone  interview  using  the  questionnaire  found  in  Attach¬ 
ment  A.  In  the  next  Section  IV,  the  results  of  the  tele¬ 
phone  interviews  will  be  described  in  detail.  The  data  ga¬ 
thered  from  the  questionnaires  will  be  compiled  and  analyzed 
for  similarities  and  differences  in  managing  the  logistics 
support  for  the  sampled  COTS  systems. 
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IV .  Findings 


Introduction 

The  following  information  is  the  results  from  the  tele¬ 
phone  interviews  conducted  for  this  research  study.  The  in¬ 
formation  is  presented  by  individual  response  for  questions 
1  through  15.  See  the  methodology  section  (chapter  III)  for 
an  explanation  of  each  question  and  Appendix  A  for  the  ques¬ 
tions. 


Findings 

Command  Control  Switching  System  (CCSS) . 

Question  1.  The  CCSS  consists  of  secure  and/or  non- 
secure  command  and  control  <C2>  digital  switches.  CCSS  will 
expand  secure  voice  service  within  the  C2  elements  of  the 
Air  Force  <AF>  and  DoD  agencies.  The  CCSS  supports  all  le¬ 
vels  of  C2  from  base/wing  to  air  division  to  numbered  AF 
<NAF)  to  major  command  (MAJCOK)  to  commanders- in-chief 
(CINCs) .  The  CCSSs  allow  users  to  talk  securely  within  a 
protected  enclave  and  to  utilize  communications  security 
(COMSEC)  interfaces  to  talk  to  external  users.  There  are  57 
AF  switches,  a  total  of  154  switches  worldwide  which  include 
the  DoD  and  civilian  sector. 

Question  2.  Yes.  The  CCSS  was  modified  for  government 
use  to  interface  with  communications  security  (COMSEC) 
government  furnished  equipment  (GFE) .  The  interface  with 
the  GFE  was  required  to  improve  the  performance  of  the  GFE 
by  reducing  crosstalk  and  to  meet  TEMPEST  requirements. 

Question  3.  The  CCSS  will  have  contractor  logistics 
support  (CL S)  for  the  life  of  the  system.  There  will  only 
be  one  contractor  to  support  the  system  (Electrospace  Sys¬ 
tems  I  nc .  )  . 

Question  4 .  The  maintenance  support  for  the  CCSS  will 
be  contractor  maintained  until  an  organic  maintenance  capa¬ 
bility  can  be  developed.  Cost  estimates  revealed  it  will  be 
cheaper  if  we  use  blue-suit  (organic)  coverage  versus  con¬ 
tractor.  A  large  part  of  the  current  customer  dissatisfac¬ 
tion  is  being  caused  by  the  lack  of  adequate  user  training. 
The  logistics  manager  recommended  the  contractor  provide 
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training  videos  to  resolve  the  training  problems  at  all  ba¬ 
ses  that  have  the  CCSS. 


Question  5.  Commercial  manuals  for  the  CCSS  will  be 
purchased  for  each  site.  Manual  changes  or  revisions  re¬ 
sulting  from  Class  I  engineering  changes  shall  be  submitted 
to  the  Air  Force  for  review  and  approval  at  least  60  days 
prior  to  implementation  at  any  location.  The  contractor 
shall  submit  contractor  furnished  equipment  <CFE)  notices 
that  provide  information  and  recommendations  to  the  USAF  for 
selection  of  manuals  required  for  logistics  support  of  the 
CCSS  equipment.  The  contractor  shall  provide  monthly  sched¬ 
ule  and  status  reports  for  technical  manuals  and  revisions 
to  be  acquired  under  the  contract. 

Question  6.  Yes.  The  heart  of  the  AFLC.  secure  voice 
system  is  the  secure  CCSS,  commonly  called  the  Red  Switch. 
This  is  a  ’’secure  only”  switch,  which  can  be  coupled  to  a 
’’nonsecure  only”  switch  to  provide  total  communications 
within  a  facility.  The  secure  switch  interfaces  with  the 
existing  long-haul  connectivity  such  as  AUTOSEVOCOM,  STU- 
I  Is,  STU-IIIs,  and  provides  unlimited  secure  conferencing. 
The  prime  contractor  performed  the  integration.  The  sys¬ 
tem’s  configuration  is  not  unique  to  the  USAF. 

Question  7.  On  the  job  training  (OJT)  for  the  CCSS  was 
considered  in  the  interim  contract.  The  Air  Training  Com¬ 
mand  CATO  will  provide  resident  training  (type  three)  if 
they  are  given  two  years  to  prepare  and  if  the  USAF  provides 
a  switch  for  training  use  at  the  USAF  school  location.  Due 
to  the  cost  of  obtaining  a  switch,  it  would  not  be  cost  ef¬ 
fective  to  task  ATC  for  the  training.  Therefore,  the  con¬ 
tractor  shall  provide  factory  (type  one'1  training  to  person¬ 
nel  of  Air  Force  specialty  code  (AFSC)  306X1  or  362X1. 
Training  will  be  on-going  through  the  life  of  the  contract. 
Training  shall  be  commensurate  to  a  five-level  (specialist, 
between  apprentice  and  journeyman  level)  or  equivalent. 

Question  8.  Yes.  The  contractor  provides  the  analy¬ 
sis  of  trends  concerning  the  frequency  of  line  replaceable 
units  (LRUs)  and  tracks  shipments  of  failed  and  replacement 
parts  for  the  CCSS.  The  contractor  provides  spare  parts  in 
sufficient  quantities  to  sustain  equipment  performance  for 
60  days  without  resupply.  If  the  spare  parts  provided  do 
not  meet,  the  60  day  need,  the  contractor  will  be  notified 
and  shall  adjust  the  levels  to  assure  a  60  day  minimum  re¬ 
supply.  The  government,  reserves  the  right  to  call  a  review 
of  the  spares  level  if  two  or  more  valid  emergency  demands 
occur  within  60  days.  Under  emergency  conditions,  the  con¬ 
tractor  shall  ship  the  replacement  spare  part  to  arrive  at 
overseas  or  CONUS  locations  within  24  hours  after  receipt  of 
order . 
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Question  9.  Instead  of  requesting  the  CCSS  contractor 
to  establish  a  common  baseline,  the  government  recommends  a 
baseline  with  complete  justification  for  each  change.  The 
government  reserves  the  right  to  approve/disapprove  the  con¬ 
tractor’s  proposed  changes.  This  gives  the  government  two 
advantages.  First,  we  govern  the  baseline  and  restrain  the 
contractor  from  proposing  a  baseline  which  is  over  and  above 
the  baseline  for  any/all  government  CCSS’ s.  Second,  the  go¬ 
vernment  drastically  diminishes  or  eliminates  the  need  for 
site  surveys  and  can  implement  full  depot  support  in  a  time¬ 
ly  fashion.  Benefits  should  result  in  significant  cost  sav¬ 
ings.  Consolidated  inputs  will  determine  a  baseline  for  in¬ 
corporation  into  the  request  for  proposal  (EFP) . 

Question  10.  The  CCSS  contractor  shall  provide  a  con¬ 
figuration  management  plan  for  hardware  and  software.  All 
site  specific  software  configuration  items  will  be  identi¬ 
fied  and  described  in  the  version  description  document  ap¬ 
plicable  to  each  CCSS  installation.  A  government  configu¬ 
ration  control  board  (CCB)  will  evaluate  each  Class  I  engi¬ 
neering  change  proposal  (ECP)  for  approval  or  disapproval. 

Question  1 1 .  No.  The  CCSS  contractor  provides  ship¬ 
ping  containers  to  the  site  and  is  responsible  for  shipment 
of  spares  including  vendor  equipment  both  to  and  from  the 
site.  The  only  facility  considerations  are  the  requirements 
that  the  switch  be  located  within  a  protected  area  (red 
enclave) . 

Question  12.  Usually  COTS  are  fielded  without  inte¬ 
grated  logistics  support  (ILS)  because  ILS  slows  the  process 
for  the  program  action  officer  (PAO)  to  field  the  system. 

The  manager  would  not  have  used  logistics  support  analysis 
(LSA)  procedures  to  develop  full  ILS  for  the  system.  The 
PAO  no  longer  uses  full  ILS  for  COTS. 

Question  13.  Yes.  An  ILS  representative  must  be  kept 
involved  in  the  acquisition  management  process.  The  PAO  us¬ 
ually  takes  short  cuts  and  actions  necessary  to  get  the  sys¬ 
tem  fielded  to  satisfy  the  customer  requirements  within  the 
projected  milestone. 

Question  14.  Yes.  Very  few  communications  systems  are 
implemented  through  research  and  development  (R&D).  To 
implement  and  develop  a  new  system  through  R&D  utilizing  or¬ 
ganic  support  will  take  five  years  (providing  there  are  no 
set  backs  which  could  delay  the  program).  Provisioning  a 
communications  system  is  becoming  a  "by-gone  era."  The  pro¬ 
visioning  effort  is  not  cost  effective.  Just  assigning  a 
national  stock  number  <NSN)  to  a  COTS  communications  system 
part  costs  approximately  $2,000.  Also  the  NSN  process  re¬ 
quires  a  coordination  with  a  myriad  number  of  government 
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offices  to  do  many  tasks  such  as  getting  the  item  cataloged, 
registering  the  USAF  as  the  user,  putting  the  item  at  a  cen¬ 
tral  storage  warehouse,  determine  its  shelf  life,  etc.  This 
tedious  process  can  add  as  many  as  18  to  24  months  to  the 
program’s  development.  Technology  in  the  communications 
equipment  arena  is  moving  too  rapidly.  By  the  time  we  get  a 
system  fielded,  it  has  become  obsolete. 

Question  15.  Yes.  Manpower  and  budget  cuts  will  af¬ 
fect  the  supportabi 1 ity  of  the  CCSS  program.  Currently,  the 
MAJCOMs  are  being  forced  to  cut  manpower  in  order  to  meet 
budget  restraints.  Since  organic  maintenance  support  has 
proved  to  be  cheaper  for  this  program,  the  USAF  will  be 
forced  to  go  back  to  more  expensive  CLS  contracts  as  the 
manpower  cuts  begin  to  affect  the  mission  capability  of  pro¬ 
gram.  To  resolve  this  conflict  in  higher  expenditures,  USAF 
PAOs  should  take  funds  from  lower  priority  programs  to  as¬ 
sure  the  best  support  for  mission  essential  programs  like 
the  CCSS. 


GTE  Red  Telephone  Switching  System  (RTSS) . 

Question  1.  The  RTSS  is  a  telephone  switch  that  sup¬ 
ports  red  (secure)  and  black  (non-secure)  command  and  con¬ 
trol  telephone  systems  between  commanders  and  their  agen¬ 
cies.  It  is  configured  to  operate  as  a  black  interface  and 
computer  interface  with  voice  STU-III/ri  instruments  and 
black  telephones.  Alsc ,  the  RTSS  may  be  used  as  a  telecon¬ 
ferencing  between  all  black  or  red  subscriber  equipment. 

The  RTSS  is  a  1.8  billion  dollar  USAF  program  scheduled  to 
be  installed  at  all  CINCs,  at  the  National  Military  Command 
Center  (NMCC) ,  the  Alternate  NMCC  (ANMCC) ,  Joint  Chiefs  of 
Staff,  MAJCOM  command  centers  in  FORCOM,  European  Command, 

HQ  PACAF,  Yakota,  and  Clark.  Fifty  percent  of  the  system 
cost  is  in  logistics  support.  The  contract  allows  for  pur¬ 
chase  of  as  many  as  300  switches  by  FY  1997,  and  eight  are 
on  order  for  FY  1990  with  the  first  switch  scheduled  for  ac¬ 
ceptance  testing  on  1  July  1990,  The  RTSS  is  similar  to  the 
AN/TTC-39  mobile  switching  system. 

Question  2.  Yes.  The  RTSS  was  modified  to  meet  red/ 
black  TEMPEST  standards  and  to  make  GFE  adaptive  to  commerc¬ 
ially  available  components  used  within  the  system.  A  pri¬ 
mary  concern  with  integrating  the  red/black  criteria  was  to 
determine  the  vendor  personnel  who  (civilians)  could  work 
around  special  corapartroenta 1  information  (SCI)  processing 
areas.  The  RTSS  is  based  on  the  concepts  of  the  AN/TTC-39 
switching  system,  but  very  little  is  in  common  past  that 
point  (about  30%  commonality  exists).  However,  the  RTSS 
still  uses  true  COTS  TEMPEST  computers,  power  supplies,  etc. 
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About  407.  of  the  RTSS  is  new  development.  The  RTSS  required 
16  ECPs  prior  to  the  initial  deliver/installation. 


Question  3.  The  RTSS  has  several  options  for  logis¬ 
tics  support  under  a  two-level  concept  (organizational  and 
depot):  1)  full  CLS  at  the  organizational  level  (40  hour 

work  week  with  a  maximum  two  hour  restoration  time  after 
normal  duty  hours),  2)  full  CLS  at  the  organizational  level 
(24  hours  per  day  seven  day  per  week  with  a  maximum  20  min¬ 
ute  restoration  time),  or  3)  100%  organic  USAF  logistics 
support.  At  the  depot  level,  only  GTE  maintains  the  equip¬ 
ment  (authorized  factory  repairs).  PACAF  will  use  option 
one.  The  three  Army  switches  will  convert  to  option  three 
after  the  one  year  warranty  ends.  Most  other  USAF  and  DoD 
locations  will  use  option  two.  The  manufacturer  is  prime 
contractor  for  the  CLS  contracts,  but  this  prime  contractor 
subcontracts  work  out  to  three  other  companies  for  worldwide 
support.  There  can  be  some  problems  coordinating  rt-’c.'rs  on 
hardware  between  the  three  subcontractors  and  the  prime  con¬ 
tractor  . 

Question  4.  The  contract  is  still  too  new  to  discover 
any  advantages  or  pitfalls.  However,  the  contract  was  modi¬ 
fied  to  enhance  the  system  expense  accounting  procedures  by 
going  to  monthly  billing  instead  of  single  repair  action 
billing.  Also,  the  contract  modification  included  a  provis¬ 
ion  to  allow  the  contractor  to  update  software,  technical 
manuals,  and  hardware  when  required. 

Question  5.  The  commercial  manuals  are  adequate.  Once 
the  contract  modification  takes  place,  updates  to  the  manu¬ 
als  will  be  done  regularly.  The  USAF  has  had  some  difficul¬ 
ty  getting  past  technical  manual  problems  resolved  (two  807. 
in-progress  reports  (IPRs),  three  validation  attempts,  and 
final  technical  order  validation  rescheduled  for  July  1990). 
The  USAF  does  not  own  the  data  rights  to  the  engineering 
drawings  or  the  technical  manuals  for  the  RTSS.  GTE  has 
agreed  to  notify  the  USAF  within  180  days  of  any  reprocure¬ 
ment  rights  for  the  RTSS  which  may  force  the  USAF  to  support 
the  system  with  another  CLS  vendor  (or  by  using  USAF  organic 
capabilities).  GTE  will  charge  the  USAF  fees  to  reformat 
technical  manuals  and  to  provide  copies  of  extra  authorized 
manuals  that  exceed  the  original  system  manuals  which  are 
supplied  with  the  original  equipment. 

Question  6.  Yes.  The  USAF  is  charged  with  interfacing 
the  GTE  RTSS  with  GFE  for  DoD  through  special  interface 
equipment.  GTE  subcontracted  the  interfacing  process.  The 
RTSS  is  not  unique  to  the  USAF  because  it  will  be  used 
throughout  DoD  (except  the  Navy  wants  to  use  their  own  ver¬ 
sion)  .  The  primary  problems  with  the  integration  effort 
were  1)  due  to  the  dynamic  changes  within  the  C.0MSEC 
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equipment  and  2)  subcontract  items  did  not  interface  or  meet 
government  specifications.  The  USAF  decided  the  RTSS  will 
be  the  standardized  system  to  replace  older/obsolete  systems 
located  within  the  USAF  and  DoD  to  resolve  the  multitude  of 
interfacing  problems  with  the  older  systems. 

Question  7.  The  RTSS  will  have  three  types  of  train¬ 
ing:  1)  contractor  sponsored  training  for  government  quali¬ 
ty  evaluators,  2)  in-factory  training  for  two  years  for 
joint  service  personnel  and  civilian  users  that  will  revert 
to  an  ATC  training  responsibility  (with  all  training  mater¬ 
ials  from  the  factory  going  to  USAF  trainers),  and  3)  fac¬ 
tory  sponsored  field  training  provided  once  per  base  with 
seven  weeks  of  classroom  and  two  weeks  of  OJT  (all  subse¬ 
quent  training  will  be  conducted  by  base  personnel  for  the 
life  of  the  system).  The  main  problem  with  training  oc¬ 
curred  with  the  first  course  because  there  was  not  an  in¬ 
stalled  system  to  use  as  training  equipment.  USAF  students 
say  the  training  is  adequate  and  the  Armv  students  say  it  is 
not  adequate. 

Question  8.  Yes.  The  RTSS  has  a  built-in  on-line  re¬ 
dundant  feature  to  decrease  the  chance  of  downtime  due  to 
failure  of  critical  spares.  The  prime  contractor  is  the 
sole  provider  for  spare  parts  for  the  RTSS  program  and  has  a 
20  year  prepriced  schedule  for  these  parts.  GTE  will  place 
spare  parts  at  strategic  shipping  locations  (to  maintain  a 
seven  day  priority/critical  part  list  to  be  available  at  any 
of  the  worldwide  locations  within  24  hours  for  emergency  re¬ 
supply)  after  the  USAF/DoD  contract  is  negotiated  and  pro¬ 
vided  for  in  the  USAF  budget. 

Question  9.  Spare  parts  could  become  unique  to  al¬ 
ready  delivered  RTSSs,  and  the  potential  will  exist  for  pro¬ 
duction  spares  to  be  nonfunctional  in  production  systems  (if 
the  configuration  changes).  Hopefully,  the  production  sys¬ 
tems  will  remain  operational  after  configuration  changes. 

The  USAF  added  a  clause  into  the  contract  to  make  the  prime 
contractor  responsible  for  spare  parts  upgrades  and  to 
maintain  site  configuration  control. 

Question  10,  The  RTSS  has  site  configuration  control 
clauses  built  into  the  contract  to  protect  the  USAF/DoD  from 
configuration  changes  to  the  system. 

Question  11.  No.  There  are  no  foreseeable  problems 
because  GTE  is  responsible  for  damages  caused  by  improper 
packaging,  handling,  shipping,  and  transportation  (PHS&T) 
for  RTSS  parts.  The  contractor  must  meet  red  facility 
installation  criteria  and  are  monitored  by  government  per¬ 
sonnel  to  insure  the  contractor  meets  these  standards. 
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Question  12.  The  USAF  should  harden  the  RTSSs  against 
high  altitude  nuclear  electromagnetic  pulse  radiation  blasts 
(HEMPing) .  The  USAF  should  also  purchase  level  III  engin¬ 
eering  drawings  up  front  and  fully  provision  the  PTSSs 
through  the  USAF/DoD  supply  system  versus  buying  everything 
from  the  prime  contractor.  Since  spares  kits  can  be  abused 
by  ’’stuffing”  them  full  of  unnecessary  and  expensive  parts, 
the  government  should  outlaw  their  use  permanently.  Alter¬ 
natively,  government  planners  should  use  proven  forecasting 
techniques  to  preposition  parts  that  are  justified  against 
expected  system  failure  rates  instead  of  using  blind  guesses 
to  ’’stuff”  spares  kits. 

Question  13.  Yes,  but  it  depends  upon  the  program 
requirements.  For  example,  all  black  telephone  circuits, 
personal  computers,  some  airline  avionics,  radios,  etc. 
qualify  as  pure  COTS.  The  manager  questioned  any  govern¬ 
ment  intentions  to  call  modified  systems  pure  COTS  (such  as 
the  following  two  examples:  a  VAX  8010  computer  is  COTS  but 
a  red  telephone  switch  is  not,  and  an  inertial  navigational 
system  can  be  COTS  until  the  government  tries  to  apply 
design  or  performance  specifications  to  the  purchase  con¬ 
tract)  . 

Question  14.  Yes.  Buying  from  the  lowest  bidder  could 
easily  result  in  a  lack  of  worldwide  product  support.  For 
example,  the  USAF  should  buy  the  name  brand  leader  for 
personal  computers  such  as  the  IBM  PC  instead  of  a  clone 
from  a  smaller  company.  When  the  smaller  company  is  re¬ 
quired  to  build  spares  to  support  the  USAF’s  worldwide  mis¬ 
sion  (coupled  with  the  problem  that  neither  the  USAF  nor  the 
company  owns  the  design  rights  to  the  original  PC  circuit 
boards)  may  force  the  smaller  firm  to  go  out  of  uusiness. 
Another  problem  with  COTS  systems  occurs  when  the  government 
has  to  interface  the  commercial  system  with  MIL-SPEC  systems 
(such  as  the  red  switch) .  The  best  advantage  of  buying  COTS 
occurs  from  the  fact  that  an  initial  purchase  of  a  particu¬ 
lar  system  sets  a  precedence  for  buying  additional  units  in 
the  future  through  sole  source  contracts  in  order  to  main¬ 
tain  standardization. 

Question  15.  Yes.  Any  cuts  in  the  budget  will  affect 
the  KTSS  CLS  contract  which  only  costs  $73,000  per  year  for 
a  PACAF  site  that  has  the  40  hour  option.  Cuts  will  require 
the  government  to  either  renegotiate  the  CLS  contract  at  a 
higher  price  or  to  convert  to  organic  logistics  support  at 
significant  added  costs.  The  manager  found  through  research 
that  for  every  CLS  technician  replaced  by  an  USAF  organic 
capability  would  require  four  to  five  USAF  technicians  (this 
additional  cost  would  result  if  the  CLS  budget  were  re¬ 
duced)  .  Since  neither  money  nor  additional  manpower  would 
be  available  under  cutbacks  in  the  3400  budget  for  CLS  depot 
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and  site  maintenance,  the  logistics  manager  would  have  no 
choice  but  to  eliminate  logistics  support  for  some  switches 
(not  possible  since  this  is  interfaced  with  COMSEC  equip¬ 
ment). 


2246A  Oscilloscope, 

Question  1.  The  Tektronix  2246A  oscilloscope  is  a  dual 
trace  bench  test  oscilloscope  that  has  a  100  megahertz  band¬ 
width.  The  oscilloscope  is  supported  by  San  Antonio  ALC, 

TX.  The  oscilloscope  replaces  90  older  oscilloscopes  with 
different  stock  numbers.  Many  commercially  available  plug¬ 
in  option  boards  are  available  to  increase  the  capabilities 
of  the  2246A  oscilloscope.  The  oscilloscope  is  used  by  all 
operational  commands  worldwide. 

Question  2.  No.  The  2246A  oscilloscope  was  not  modi¬ 
fied  for  government  use. 

Question  3.  Tektronix  is  the  manufacturer  of  the  2246A 
oscilloscope  who  will  provide  the  logistics  support  with  a 
five  year  100%  parts  and  labor  warranty.  After  three  years 
of  operation,  logistics  support  could  convert  to  an  organic 
capability  at  the  base  PMELs  if  cost  data  show  an  economic 
savings  versus  another  five  year  warranty  with  Tektronix. 
Limited  calibrations  and  adjustments  are  still  made  by  base 
PMELs  (limited  organizational  maintenance  only). 

Question  4,  The  factory  warranty  maintenance  concept 
for  the  2246A  oscilloscope  has  improved  the  overall  support 
for  USAF  oscilloscopes  as  well  as  the  advantage  enjoyed  by 
replacing  90  older  models  with  only  one  oscilloscope  (the 
2246A) .  Since  the  system  has  been  in  operational  use  for  18 
months,  some  quality  deficiency  reports  (QDEs)  have  been  in¬ 
itiated  at  the  organizational  level.  Three  week  turn  around 
times  from  the  factory  for  the  QDKs  has  been  excellent  to 
date . 


Question  5.  The  commercial  manuals  for  the  2246A  os¬ 
cilloscope  are  adequate.  The  manuals  were  certified  by  the 
USAF  AGMC  standards  lab,  and  a  USAF  technical  order  (T.O. ) 
number  was  assigned  to  the  manuals.  A  T.O.  cover  sheet  was 
attached  to  the  front  cover  of  the  commercial  manuals.  All 
updates  to  the  manuals  from  the  factory  are  sent  to  the  San 
Antonio  ALC  for  approval  and  copying.  These  approved  chan¬ 
ges  are  mailed  to  organizational  units  who  operate  and  main¬ 
tain  the  oscilloscope.  Problems  encountered  with  the  oscil¬ 
loscope  are  resolved  at  the  San  Antonio  ALC  using  engineer¬ 
ing  change  proposals  (ECPs) . 
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Question  6.  No.  The  2246A  oscilloscope  presented  no 
unusual  interfacing  problems.  The  oscilloscope  is  not 
unique  to  the  USAF. 

Question  7.  The  2246A  oscilloscope  does  not  require 
special  factory  or  ATC  training.  The  ATC  training  at  Lowry 
AFB,  CO  gives  military  technicians  fundamental  training  in 
the  maintenance  of  similar  oscilloscopes.  USAF  civilians 
must  show  oscilloscope  repair  knowledge  (as  well  as  other 
test  equipment  repair  skills)  prior  to  hiring  by  USAF  pel — 
sonnel  offices.  Currently  there  are  no  problems  with  the 
training  format  for  the  military  test  equipment  technicians. 

Question  8,  Yes.  The  vendor  provides  critical  fail¬ 
ure  parts  for  the  2246A  oscilloscope.  There  are  no  spare 
parts  problems. 

Question  9.  The  vendor,  Tektronix,  must  notify  the  San 
Antonio  ALC  for  any  configuration  changes  to  the  2246A 
oscilloscope.  The  configuration  has  remained  operational 
after  configuration  changes. 

Question  10.  Configuration  changes  to  2246A  oscillo¬ 
scope  are  governed  by  clauses  in  the  original  acquisition 
contract . 

Question  11.  No.  There  are  no  PHS&T  problems  for  the 
Tektronix  2246A  oscilloscope. 

Question  12.  The  2246A  oscilloscope  does  not  require 
any  improvements. 

Question  13.  Yes,  The  government,  should  have  bought 
more  COTS  systems  a  long  time  ago,  and  the  USAF  should  defi¬ 
nitely  continue  to  buy  more  COTS  items  with  interchangeable 
circuit  cards  (slide-in  and  slide-out). 

Question  14.  Yes.  Both  the  USAF  and  DoD  were  at  a 
greater  disadvantage  by  using  MIL-SPEC  systems  when  rugged- 
ized  COTS  systems  were  available  to  satisfy  the  mission  re¬ 
quirements. 

Question  15.  Yes,  budget  and  manpower  cuts  may  affect 
the  supportabi 1 i ty  for  the  2246A  oscilloscope.  During  the 
next  three  and  one  half  years  the  oscilloscope  will  be  unaf¬ 
fected  by  any  cuts  because  it  is  covered  by  the  factory  war¬ 
rantee.  There  is  too  much  politics  concerning  the  purchase 
of  COTS  systems  that  could  jeopardize  funding  requirements. 
If  funding  is  discontinued  for  this  system,  the  USAF  will  be 
forced  to  salvage  broken  equipment  through  the  Defense  Man¬ 
agement  Reutilization  Offices  (DMROs)  and  cut  organic  fund¬ 
ing.  The  politics  and  expected  cutbacks  will  prevent  the 
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approval  of  a  waiver  to  continue  the  vendor’s  warrantee  for 
another  five  years. 


5100B  Meter  Calibrator. 


Question  1.  The  5100B  (Option  3  and  Option  5)  Fluke 
meter  calibrator  is  a  universal  piece  of  test  equipment  used 
by  all  USAF  base  Precision  Measurement  Equipment  Laborator¬ 
ies  (PMELs)  worldwide.  The  calibrator  is  used  as  a  secon¬ 
dary  standard  to  calibrate  other  test  equipment  used  by  Air 
Force  technicians  at  the  base  level.  There  are  295  of  the 
calibrators  in  use. 

Question  2.  No.  The  system  was  not  modified  for 
government  use. 

Question  3.  The  Fluke  5100B  meter  calibrator  is  sup¬ 
ported  at  the  organizational  level  by  base  PMELs  and  at  the 
depot  level  by  the  Aerospace  Ground  Meteorological  Center 
<AGMC) .  The  meter  calibrator  has  been  100%  organic  1ogis- 
tics  support  since  January  1988. 

Question  4.  The  maintenance  support  has  neither  im¬ 
proved  nor  degraded.  The  Fluke  5100B  meter  calibrator  was 
too  new  to  see  any  changes  in  the  maintenance  support. 

Question  5.  The  commercial  manuals  for  the  Fluke  5100B 
meter  calibrator  are  adequate.  Normal  updates  to  the  manu¬ 
als  are  handled  through  the  San  Antonio  ALC.  No  problems 
have  been  encountered  with  the  manuals  to  date. 

Question  6.  No.  The  Fluke  5100B  meter  calibrator 
presented  no  unusual  interfacing  problems.  The  meter  cali¬ 
brator  is  not  unique  to  the  USAF. 

Question  7.  The  Fluke  5100B  meter  calibrator  does  not 
require  any  special  training  courses  by  the  factory  or  the 
ATC.  Test  equipment  technicians  use  commercial  manuals  to 
self-train  themselves  to  repair  and  maintain  the  meter  cali¬ 
brator  . 

Question  8 .  Yes.  The  critical  failure  parts  for  the 
Fluke  5100B  meter  calibrator  are  adequate.  Fluke  is  the  on¬ 
ly  spare  parts  manufacturer  for  the  meter  calibrator.  Some 
routing  delays  have  occurred  in  the  past,  otherwise,  the 
supply  support  is  fine.  To  alleviate  possible  problems  with 
spare  parts,  the  spares  were  included  as  part  of  the  acqui¬ 
sition  contract. 

Question  9.  The  Fluke  5100B  meter  calibrator  does  not 
have  any  support  problems  created  with  the  spare  parts  if 
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the  vendor  makes  configuration  changes.  However,  the  item 
manager  believed  the  USAF  should  obtain  supplemental  data  on 
configuration  changes  that  affect  the  spare  parts  in  case 
the  USAF  consumes  all  of  the  spares  that  were  purchased  dur¬ 
ing  the  initial  acquisition. 

Question  10.  This  question  is  not  applicable  to  the 
Fluke  5100B  meter  calibrator. 

Question  11.  Ho.  Since  the  Fluke  5100B  meter  cali¬ 
brator  is  a  bench  top  item,  there  are  no  facility  or  PHS&T 
problems. 

Question  12.  The  Fluke  5100B  meter  calibrator  does  not 
have  any  logistics  support  problems. 

Question  13.  Yes.  The  government  should  buy  more  COTS 
systems.  There  were  no  recommendations  for  other  types  of 
COTS  systems. 

Question  14.  Yes.  The  USAF  should  find  a  better  way 
to  track  part  number  changes  for  COTS  systems.  COTS  systems 
save  time  and  have  proven  reliability  in  the  commercial  en¬ 
vironment  because  the  contractor  has  done  all  of  the  devel¬ 
opment  and  set  up  a  spare  parts  supply  network. 

Question  15.  Yes.  Operations  and  maintenance  (O&M) 
funding  cuts  may  hurt  the  supportabi 1 i ty  for  the  Fluke  5100B 
meter  calibrator,  but  the  universal  application  allows  base 
PMELs  to  cross  utilize  personnel  to  maintain  this  system. 

C-21  Aircraft. 

Question  1.  The  C-21  is  a  Leer  jet  Model  35.  It  seats 
eight  passengers  and  was  purchased  to  support  worldwide 
transportation  requirements  for  the  USAF  and  the  ANG.  Its 
commercial  design  is  for  shuttling  corporate  executives  for 
business  travel.  There  are  more  Model  35s  in  use  commer¬ 
cially  than  in  the  USAF.  The  USAF  bought  78  for  HQ  MAC, 
four  for  the  ANG,  and  one  for  AFSC.  The  83  planes  are  as¬ 
signed  to  16  bases  worldwide.  The  78  HQ  MAC  planes  are  sup¬ 
ported  by  100%  CLS.  The  four  ANG  and  one  AFSC  planes  have 
partial  CLS  at  organizational  and  intermediate  levels. 

Question  2.  Yes,  but  the  C-21  aircraft  are  pure  COTS 
except  for  the  GFE  black  boxes.  The  maintenance  support 
contract  was  modified  to  meet  USAF  mission  capable  (MC) 
rates.  The  C-21  were  also  modified  to  include  electronic 
GFE  and  USAF  painting  schemes  (to  conform  to  USAF  marking 
schemes) . 
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Question  3.  The  C-21  aircraft  have  both  CLS  and  or¬ 
ganic  organization  logistics  support.  HQ  MAC  chose  to  sup¬ 
port  their  aircraft  with  full  CLS,  and  the  AUG  and  AFSC 
chose  organic  logistics  support.  The  depot  logistics  sup¬ 
port  is  done  by  the  manufacturer  (Leer).  The  forward  supply 
points  are  supported  by  contractor  operated  and  maintained 
base  supplies  (COMBS)  located  on  or  near  the  flightlines 
(except  the  ANG  and  AFSC,  who  use  an  organic  forward  supply 
point  at  the  bases  v here  they  support  C-21s) .  CLS  is  done 
only  by  Leer  and  stand  alone  engineering  is  done  through 
separate  contracts  as  required. 

Question  4.  Originally  between  83  and  85  C-21  air¬ 
craft  were  leased  and  later  purchased  under  a  contract  that 
required  the  contractor  to  keep  the  aircraft  at  a  fully  mis¬ 
sion  capable  (FMC)  rate  of  85%.  To  date,  the  contractor  has 
a  FMC  rate  which  exceeds  95%.  The  contract  also  includes  a 
liquidated  damage  clause  that  allows  the  USAF  to  withhold 
part  of  the  contractor’s  monthly  billing  if  the  85%  FMC  rate 
or  USAF  supply  support  standards  are  not  met.  The  USAF  is 
also  adding  some  military  requirements  to  the  system  at 
cost.  The  aircraft  has  met  or  exceeded  FAA  specifications. 

Question  5.  The  USAF  does  not  own  the  maintenance 
manuals  for  the  C-21  aircraft.  The  USAF  does  have  dash  one 
(flight  manuals)  T.O.s  which  are  the  commercial  flight  man¬ 
uals  with  USAF  T.O.  cover  sheets  attached  to  the  front  co¬ 
vers.  However,  the  ANG  has  developed  unapproved  maintenance 
manuals  (not  fully  within  MIL-SPECs).  The  Military  Airlift 
Command  (HQ  MAC)  wants  fully  MIL-SPEC  analysis  for  the  dash 
one  T.O.  (this  will  insure  that  the  manuals  meet  MIL-SPEC 
standards  for  training  and  operation  of  the  aircraft).  All 
changes  to  the  commercial  manuals  are  sent  (per  terms  in  the 
CLS  contract)  to  the  Oklahoma  City  ALC  where  these  changes 
are  copied,  stocked,  stored,  and  issued  for  the  organiza¬ 
tional  units. 

Question  6.  No.  The  C-21  aircraft  presented  no  unu¬ 
sual  interfacing  problems.  The  C-21  is  not  unique  to  the 
USAF. 

Question  7.  AFLC  does  not  conduct  any  training  for  the 
C-21  aircraft.  HQ  MAC  conducts  training  for  base/vendor 
personnel  (base  personnel  consist  of  quality  assessment 
evaluators  (QAEs) )  at  bases  where  the  C-21s  are  assigned. 

The  CLS  contractor  trains  in-house  for  their  support  people 
to  insure  these  personnel  meet  FAA  certification  standards. 
The  acquisition  contract  included  initial  organizational  and 
intermediate  maintenance  training  for  CLS  and  USAF  <QAE) 
personnel  and  initial  FC.F  (flight  operations)  training,  All 
requests  for  additional  training  for  USAF  personnel  is  fund¬ 
ed  separately  from  the  original  acquisition  contract. 
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Question  8.  Yes.  The  contractor  supplies  critical 
failure  parts  for  the  C-21  aircraft  within  USAF  supply  stan¬ 
dards,  or  the  contractor  faces  liquidated  damages  <a  percen¬ 
tage  off  of  the  monthly  billing  for  failure  to  meet  the  cri¬ 
teria).  Since  the  contractor  provides  all  spares,  the  USAF 
does  not  have  to  own  any  spare  parts.  The  USAF  looks  for 
the  top  ten  percent  failure  items  that  are  creating  a  trend 
for  repetitive  replacement.  If  items  are  repetitively  fail¬ 
ing,  the  USAF  may  ask  the  vendor  for  modifications  that  will 
correct  the  high  failure  rates. 

Question  9.  The  USAF  normally  would  not  force  the 
modification  to  the  C-21  aircraft  because  the  vendor  would 
update  the  system  to  his  advantage  for  reasons  such  as 
flight  safety  or  cost  savings  to  maintain  the  aircraft.  The 
vendor  can  not  change  the  form,  fit,  or  function  (F3)  of  the 
aircraft  without  USAF  approval  because  the  change  could  im¬ 
pact  the  flight  safety.  If  flight  safety  is  affected  be¬ 
cause  a  change  needed  to  be  implemented,  the  USAF  works  with 
the  vendor  to  issue  an  immediate  time  compliance  technical 
order  (TCTO) .  All  other  changes  are  negotiated  between  the 
vendor  and  management  at  the  Oklahoma  City  ALC. 

Question  10.  TCTOs  are  issued  for  flight  safety  chan¬ 
ges  to  the  C-21  aircraft,  otherwise  configuration  changes  by 
the  vendor  are  negotiated  with  mangers  at  the  Oklahoma  City 
ALC . 


Question  1 1 .  Yes.  Pilot  seasoning  is  difficult  when 
flying  VIPs.  Cleanliness  is  very  important  for  the  C-21 
aircraft  because  it  is  highly  visible  by  executive  level 
military  and  civilians.  Outside  storage  of  these  planes  ac¬ 
celerates  damage  to  the  externally  painted  surfaces.  Host/ 
base  units  will  not  help  the  contractor  meet  this  need. 
MAJCOM  to  MAJCOM  agreements  get  sticky,  but  the  contractor 
ends  up  getting  the  blame  for  poor  appearance  when  in  fact 
it  is  the  USAF’s  problem. 

Question  12.  During  the  acquisition  process,  the  USAF 
should  stipulate  in  the  statement  of  need  (SON)  that  the 
COTS  system  with  CLS  should  remain  in  its  original  form  and 
remain  CLS  for  the  life  of  the  system.  The  USAF  should  not 
add  MIL-SPEC  items  or  modifications  to  the  system,  ask  for 
engineering  and  technical  data,  or  plan  organic  logistics 
support  after  deciding  to  buy  pure  COTS  with  full  CLS. 

Question  13.  Yes,  the  USAF  should  buy  more  COTS  sys¬ 
tems  with  CLS.  The  USAF  is  currently  pursuing  this  with  the 
acquisition  of  the  COTS  tanker  training  system  (TTTS) . 
Trade-offs  have  to  be  made  when  considering  COTS  systems  for 
USAF  programs.  The  decision  depends  on  the  support  require¬ 
ments,  amount  of  funding  available,  and  manpower.  The  USAF 
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should  do  a  feasibility  to  see  if  COTS  systems  can  satisfy 
the  program’s  war  essential  missions  before  making  the  com¬ 
mitment  to  buy  the  system  as  COTS  (rather  than  developmen¬ 
tal). 


Question  14.  Yes.  There  are  both  advantages  and  dis¬ 
advantages  to  buying  COTS  systems  for  USAF  programs  that  va¬ 
ry  depending  on  the  results  of  the  programs’  feasibility 
studies,  cost  results,  and  mission  support  requirements. 

Question  15.  Yes.  If  the  annual  budget  is  cut  for  the 
C-21  aircraft  program,  the  USAF  will  cut  flying  hours  to 
minimize  CLS  and  operating  expenses. 


Front-end  Loader. 


Question  1.  The  front-end  loader  is  used  by  the  USAF 
for  construction,  maintenance,  and  rapid  runway  repair  at 
all  operational  command  bases  worldwide.  Three  vendors 
currently  supply  the  front-end  loaders:  Komatsu-Dresser , 
Caterpillar,  and  Deere-Case.  The  front-end  loader  may  be 
ordered  to  include  the  following  attachments:  fork,  buckets, 
and  a  crane-like  boom.  The  system  is  mobile  and  may  be 
transferred  from  base  to  base  to  fill  demand  requirements, 
but  the  system  is  normally  dedicated  to  a  single  location. 
The  expected  lifespan  of  the  front-end  loader  is  approxi¬ 
mately  13  years. 

Question  2.  The  front-end  loader  is  pure  COTS.  Some 
minor  modifications  were  required  to  meet  the  rigors  of  nor¬ 
thern  tier  bases  near  the  Arctic  Circle  (winterization  to 
withstand  -40  degrees  Fahrenheit).  Also,  air  transportabi 1— 
ity  modifications  were  made  to  allow  the  front-end  loader  to 
fit  inside  USAF  transport  aircraft  (to  meet  weight  distribu¬ 
tion,  height,  and  length  restrictions).  Polyurethane  paint 
was  ordered  in  the  contract  to  prolong  damage  caused  by  cor¬ 
rosive  environments  (e.g.  salt  spray  or  application  of  rock 
salt). 


Question  3.  The  front-end  loader  is  supported  by  100% 
organic  maintenance  at  base  level.  Parts  are  supplied 
through  local  parts  houses  or  through  the  Defense  Construc¬ 
tion  Supply  Center  (DCSC  in  Columbus,  OH  buys  commercial 
parts  to  support  overseas  systems  where  local  parts  houses 
are  unavailable).  Technical  data  manuals  are  available. 


Question  4 .  The  maintenance  support  concept  for  the 
front-end  loader  has  neither  improved  nor  upgraded  since 
inial  acquisition  of  the  system.  The  only  drawback  to  the 
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system  may  be  the  numerous  system  configurations  available 
from  the  various  manufacturers. 


Question  5.  The  factory  technical  manuals  are  com¬ 
plete  and  adequate  to  support  the  front-end  loader.  Changes 
are  posted  only  when  the  factory  prints  service  bulletins. 
The  USAF  does  not  have  any  access  to  the  engineering  data. 

Question  6.  No.  The  front-end  loader  presented  no 
unusual  interfacing  problems.  The  front-end  loader  is  not 
unique  to  the  USAF. 

Question  7.  The  front-end  loader  did  not  have  initial 
training  included  as  part  of  the  acquisition  contract.  ATC 
provides  training  in  the  initial  heavy  equipment  training 
course  for  USAF  military  personnel.  Otherwise,  other  USAF 
personnel  are  trained  at  the  base  level  through  an  OJT  pro¬ 
gram.  No  problems  have  occurred  to  date  with  the  current 
training  format. 

Question  8.  Yes.  Standardized  parts  are  readily 
available  either  on  the  local  economy  or  through  DCSC  for 
the  front-end  loader.  Normally  there  are  no  delays  to  ob¬ 
tain  repair  parts  whether  bases  buy  on  the  local  economy  or 
through  DCSC. 

Question  9.  If  the  manufacturer  changes  the  front-end 
loader's  configuration,  spare  parts  will  change,  but  the 
configuration  change  will  have  a  minimal  impact  on  the  USAF 
because  we  do  not  stock  the  repair  parts.  Normally,  if 
there  are  configuration  changes  for  this  type  of  equipment, 
the  core  design  remains  static.  The  best  feature  of  this 
system  is  its  commonality  with  other  heavy  construction 
equipment  (which  is  another  reason  why  configuration  changes 
will  have  only  minimal  impacts  on  the  front-end  loader). 

The  primary  problem  encountered  by  the  USAF  is  that  only 
small  quantity  buys  are  made.  Thus  interchangeable  parts 
become  less  frequent  between  front-end  loaders  over  a  period 
of  several  years.  The  Varner-Robins  ALC  attempts  to  identi¬ 
fy  the  common  parts  between  systems  (such  as  hydraulic 
o-rings,  filters,  and  noses)  to  minimize  the  problems  that 
are  created  by  the  small  quantity  buys. 

Question  10.  The  USAF  has  attempted  to  deal  with  con- 
tiguration  changes  by  identifying  common  parts  from  year  to 
year  for  the  front-end  loaders. 


Question  1 1 .  Yes.  The  front-end  loader  requires  a 
drop-bed  trailer  for  highway  transportation  and  has  no  un¬ 
usual  requirements  when  using  rail  transportation.  The 
front-end  loader  must  use  either  heated  hangars  or  outside 


4 . 15 


heaters  for  northern  tier  bases  during  the  winter  season. 

To  meet  intra-command  demands  for  the  front-end  loaders  when 
equipment  shortages  exist,  MAJCOMs  coordinate  these  moves 
through  the  Varner-Robins  program  office  that  supports  all 
loaders  worldwide. 

Question  12,  The  USAF  should  make  larger  economy  buys 
for  the  front-end  loaders  to  allow  standardization,  inter¬ 
changeability  of  parts,  and  economies  of  scale. 

Question  13.  The  manager  was  not  sure  because  there  is 
always  a  shortfall  when  considering  buying  front-end  load¬ 
ers.  More  COTS  should  be  bought  where  possible.  COTS  can 
not  always  be  used  for  every  application  such  as  combat  mis¬ 
sions. 

Question  14.  Yes.  The  advantages  of  buying  COTS  are 
that  the  product  is  already  developed  and  the  USAF  does  not 
have  to  wait  for  R&D  efforts.  The  disadvantages  may  occur 
when  the  USAF  is  forced  to  compromise  mission  accomplish¬ 
ment,  parts  may  not  always  be  available,  and  the  government 
manager  must  strike  a  balance  between  too  much  or  too  lit¬ 
tle  support  to  stay  within  the  program’s  budget  while  satis- 
flying  mission  capability  (a  "no-win”  situation). 

Question  15.  Yes.  New  front-end  loaders  are  only 
funded  for  30%  of  the  requirements.  Additional  budget  cuts 
will  result  in  more  backlogs.  This  backlog  will  increase 
maintenance  costs  because  the  USAF  will  have  to  keep  and 
maintain  the  older  front-end  loaders  for  longer  periods. 


C-20  Aircraft- 


Question  1.  The  C-20  is  a  Gulfstream  III  aircraft.  It 
seats  14  passengers  and  was  purchased  to  support  worldwide 
transportation  requirements  for  the  USAF,  very  important 
persons  special  air  missions  (VIPSAM),  the  Navy,  and  the 
Army.  The  USAF  bought  ten  for  HQ  MAC  to  provide  shuttle 
service  between  Andrews  AFB  and  Ramstein  AFB  FRG,  three  for 
VIPSAM,  two  for  the  Navy,  and  two  for  the  Army.  The  17 
planes  are  supported  by  100%  CLS.  All  planes  except  the  two 
Army  aircraft  have  contractor  depot  support. 

Question  2.  Yes.  The  C-20  aircraft  was  modified  to 
meet  military  configuration  requirements  to  include  elec¬ 
tronic  GFE  and  painting.  The  main  modifications  were  in  the 
communications  equipment. 

Question  3.  The  C-20  aircraft  are  supported  by  100% 

CLS  from  the  manufacturer  and  several  subcontractors  for  the 
life  of  the  system. 
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Question  4.  The  C-20  aircraft  has  performed  very  well 
to  meet  mission  requirements. 

Question  5.  The  USAF  does  not  own  or  maintain  any 
technical  data  for  the  C-20  aircraft.  The  USAF  will  have  to 
buy  the  technical  data  if  the  USAF  modifies  the  aircraft. 

The  contract  legally  binds  the  CLS  contractor  (manufacturer) 
to  supply  technical  data  to  different  CLS  contractors  (non¬ 
manufacturer)  who  are  awarded  the  CLS  contract  for  the  air¬ 
craft. 

Question  6 .  Yes.  The  USAF  had  to  buy  additional 
flightline  aerospace  ground  equipment  (AGE)  to  support  C-20 
aircraft  for  Andrews  AFB  and  Ramstein  AB  FRG.  The  C-20  is 
not  unique  to  the  USAF  because  it  is  commercially  available 
and  two  other  government  agencies  use  it. 

Question  7.  Training  for  pilots  who  fly  the  C-20  aii — 
craft  is  provided  by  the  factory.  Factory  technical  repre¬ 
sentatives  are  kept  at  Andrews  AFB  and  at  Ramstein  AB  FRG  to 
provide  partial  maintenance  and  training  for  CLS  personnel. 
No  problems  have  occurred  to  date  with  the  current  training 
format . 

Question  8.  Yes.  CLS  personnel  for  the  C-20  aircraft, 
have  easy  access  to  the  contractor  operated  and  maintained 
base  supply  (COMBS,  owned  by  the  USAF) .  'The  CLS  vendor 
maintains  the  COMBS  and  must  meet  supply  demand  requirements 
based  on  the  contract  requirements. 

Question  9.  The  configuration  management  for  the  C-20 
aircraft  was  built  into  the  statement  of  work  (SOW).  The 
CLS  vendor/manufacturer  keeps  the  aircraft  systems  current. 

Question  10.  The  configuration  changes  for  the  C-20 
aircraft  are  controlled  by  the  SOW. 

Question  1 1 .  No.  The  C-20  aircraft  is  not  experienc¬ 
ing  any  problems  with  facilities  or  PHS&T. 

Question  12,  No  changes  were  recommended  for  any  of 
the  logistics  support  procedures  for  the  C-20  aircraft. 

Question  13.  Yes.  The  USAF  should  buy  more  of  the 
C-20  aircraft.  Other  programs  that  could  possibly  use  COTS 
systems  must  be  evaluated  on  a  case-by-case  basis  depending 
on  the  need  and  requirements  of  the  program. 

Question  14 ,  No  opinion  was  given  for  disadvantages/ 
advantages  to  consider  when  buying  other  COTS  systems. 
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Question  15,  Yes.  Budget  and  manpower  cuts  for  the 
C-20  aircraft  will  require  the  USAF  to  cut  flying  hours  to 
stay  within  the  budget  constraints. 


Programmable  Synthesized  Signal  Generator. 

Question  1.  The  programmable  synthesized  signal  gen¬ 
erator  is  test  equipment  that  may  be  supplied  by  any  vendor 
who  can  satisfy  the  commercial  item  description  31  (CID  31) 
at  the  San  Antonio  ALC.  The  signal  generator  operates  with 
a  frequency  range  from  2  to  26  gigahertz.  CID  31  was  in¬ 
tended  to  replace  many  older  signal  generators  that  had  much 
narrower  frequency  bandwidths  and  to  allow  more  competitive 
buying  practices.  The  signal  generator  supports  aircraft 
electronic  maintenance  shops,  logistics  support  shops,  and 
common  support  equipment  at  20  to  30  USAF  MAJCOMs  and  DoD 
activities  worldwide. 

Question  2.  Yes.  The  programmable  synthesized  signal 
generator  was  modified  to  meet  the  DoD  requirements  for  fas¬ 
ter  rise  times  and  the  frequency  range  for  pulse  modulation 
testing  applications.  The  modifications  were  made  by  the 
vendor  by  changing  electronic  circuit  cards  within  the  sig¬ 
nal  generator  to  meet  the  DoD  requirements. 

Question  3.  The  programmable  synthesized  signal  gen¬ 
erator  is  maintained  100%  organic  logistics  support  at  the 
organizational/base  PMELs.  Ninety-nine  percent  of  the  depot 
level  is  done  by  organic  logistics  support  at  the  base 
PMELs.  The  remaining  one  percent  logistics  support  are  sent 
back  to  the  factory  for  repair  and  calibration  during  man¬ 
power  or  testing  facility  shortages. 

Question  4.  The  maintenance  support  for  the  program¬ 
mable  synthesized  signal  generator  improved  because  the  USAF 
consolidated  support  from  many  signal  generators  into  this 
single  national  stock  number  item. 

Question  5.  The  programmable  synthesized  signal  gen¬ 
erator  comes  with  commercial  manuals.  The  commercial  manu¬ 
als  are  adequate.  No  changes  have  been  made  to  the  signal 
generators  to  date,  but  any  future  changes  will  be  reviewed 
by  managers  at  the  San  Antonio  ALC  and  subsequently  sent  to 
organizational  units  who  own  the  signal  generators. 

Question  6.  Yes.  Some  integration  was  required  to 
replace  20  to  25  year  old  equipment.  A  government  engineer 
developed  the  requirements  for  the  programmable  synthesized 
signal  generator  to  replace  older  equipment.  The  configura¬ 
tion  is  not  unique  to  the  USAF. 
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Question  7.  Only  the  USAF  engineer  and  USAF  equipment 
specialist  assigned  at  the  San  Antonio  ALC  <SA-ALC>  received 
factory  training  for  the  programmable  synthesized  signal 
generator,  Base  level  support  personnel  are  using  the  com¬ 
mercial  training  manuals  and  the  support  from  the  SA-ALC  en¬ 
gineer  and  equipment  specialist  to  maintain  the  signal  gen¬ 
erator.  The  current  method  of  training  is  adequate  and  has 
not  created  any  problems  to  support  the  signal  generator. 

Question  8.  Yes.  The  programmable  synthesized  signal 
generator  is  a  new  system,  and  there  are  no  problems  with 
critical  spare  parts  availability.  The  USAF  has  purchased 
many  parts  based  on  factory  failure  estimates  and  USAF  item 
management  policy. 

Question  9.  The  contract  for  the  programmable  synthe¬ 
sized  signal  generator  has  provisions  that  require  the  con¬ 
tractor  to  notify  the  USAF  (in  writing)  of  configuration 
changes  that  may  affect  spare  parts.  The  USAF  will  make  ad¬ 
justments  to  spares  based  on  the  degree  of  the  change  made 
by  the  factory. 

Question  10.  The  programmable  synthesized  signal  gen¬ 
erator  configuration  control  was  addressed  during  meetings 
and  negotiations  between  the  manufacturer  and  USAF  managers 
(when  changes  negatively  impact  the  USAF) . 

Question  11.  No.  The  programmable  synthesized  signal 
generator  is  a  benchtop  item  that  does  not  have  any  PHS&T  or 
facility  problems. 

Question  12.  The  USAF  has  too  much  bureaucracy  that 
prevents  buying  additional  programmable  synthesized  signal 
generators  (as  well  as  other  automatic  test  equipment  (ATE)) 
to  have  on  the  warehouse  shelf.  Having  the  ATE  on  the  ware¬ 
house  shelves  will  allow  the  ALC  to  be  more  responsive  to 
organizational  requirements.  The  current  process  requires 
organizational  units  to  state  their  need  for  test  equipment, 
budget  and  wait  on  Congress  for  approval,  and  wait  even  lon¬ 
ger  while  the  ATE  is  purchased  from  the  vendor.  This  pro¬ 
cess  may  take  more  than  two  years  to  complete. 

Question  13.  Yes.  The  USAF  should  buy  more  program¬ 
mable  synthesized  signal  generators.  Also,  procurement  of 
COTS  equipment  depends  on  USAF  minimum  data  requirements. 

The  USAF  must  ensure  commercial  units  meet  the  minimum  re¬ 
quirements  of  a  program  before  proceeding  further  with  the 
acquisition  plans. 

Question  14.  Yes.  The  two  main  advantages  of  buying 
COTS  systems  are:  1)  COTS  systems  are  easier  to  buy  and  2) 
these  systems  are  already  developed  by  industry. 
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Question  15,  Yes.  Budget  cuts  will  prevent  buying 
additional  programmable  synthesized  signal  generators.  The 
reverse  situation  is  also  important.  If  the  government  re¬ 
quired  many  of  these  systems  during  a  war  surge,  vendors 
could  not  setup  their  manufacturing  processes  to  keep  up 
with  demand. 


Half-ton  Pickup  Truck. 

Question  1.  The  half-ton  (nicknamed  "four  by  two”) 
pickup  truck  is  a  general  purpose  vehicle  that  is  purchased 
from  five  vendors:  Chevrolet,  Dodge,  Ford,  GMC,  and  Interna¬ 
tional.  Approximately  50,000  half-ton  pickup  trucks  are  as¬ 
signed  to  every  USAF  base  worldwide. 

Question  2.  The  half-ton  pickup  truck  was  not  modified 
for  government  use.  The  USAF  purchased  the  economy  package 
(without  air  conditioning  nor  radio)  and  either  USAF  ’’Strata 
Blue”  or  with  military  camouflage  paint. 

Question  3.  The  half-ton  pickup  truck  is  100%  organi¬ 
zational  organic  logistics  support.  There  is  no  depot  lo¬ 
gistics  support  because  the  life  of  the  system  and  its  re¬ 
placement  costs  do  not  warrant  rebuilding  the  trucks  to 
” like-new”  condition.  After  a  predetermined  number  of  years 
and/or  miles  occur,  the  trucks  are  salvaged  and  replaced 
with  newer  models. 

Question  4.  The  maintenance  support  for  the  half-ton 
pickup  truck  has  been  done  completely  by  base  support  pei — 
sonnel  since  1983.  Since  1983,  bids  have  been  made  by  base 
personnel  and  local  vendors  on  a  yeai — by-year  basis  to  get 
the  least  expensive  parts  and  labor  costs.  Overall  the  USAF 
has  not  had  any  significant  problems  with  vendors  who  won 
the  contracts.  To  ease  maintenance  support,  the  USAF  mobile 
communications  units  and  the  base  support  motorpools  are  gi¬ 
ven  the  flexibility  to  order  parts  from  their  local  econo¬ 
mies.  In  isolated  overseas  areas,  USAF  units  must  buy  parts 
directly  from  the  factory  when  parts  are  not  available  on 
their  local  economies. 

Question  5.  One  copy  of  the  factory  operator’s,  re¬ 
pair,  and  parts  manuals  are  supplied  with  each  half  ton 
pickup  truck.  Occasionally,  manuals  are  not  shipped  with 
every  vehicle,  but,  since  most  bases  get  more  than  one  of 
these  trucks,  there  are  plenty  of  technical  manuals  to  sup¬ 
port  the  trucks.  The  Varner-Kobi ns  ALC  assigns  36  series 
T.O.  numbers  to  the  factory  manuals  and  ships  extra  manuals 
to  organizations  who  are  shorted  by  the  manufacturers. 
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Question  6.  No.  The  half-ton  pickup  truck  presented  no 
unusual  interfacing  problems  except  the  additional  DLD  (com¬ 
puterized  diagnostic)  test  stands  that  were  purchased  to  re¬ 
place  the  Sun  diagnostic  centers.  The  DLDs  were  necessary 
to  support  the  automotive  computers  installed  in  Chrysler 
and  GM  model  pickup  trucks.  The  primary  concern  was  to  get 
the  DLDs  prepositioned  before  the  manufacturer’s  warrantee 
ended . 

Question  7.  The  half-ton  pickup  truck  does  not  re¬ 
quire  any  special  factory  training.  Military  personnel  re¬ 
ceive  initial  automotive  maintenance  skills  through  the  ATC 
fundamental  vehicle  maintenance  repair  course.  USAF  civi¬ 
lians  must  be  experienced  automotive  mechanics  to  qualify  to 
work  in  USAF  motorpools.  The  current  training  format  is 
adequate,  and  there  are  no  training  problems. 

Question  8.  During  safety  recalls  by  the  manufacturer 
of  the  half-ton  pickup  trucks,  the  manufacturer  furnishes 
parts  and  labor  in  the  CONUS  and  parts  overseas.  Some  de¬ 
lays  occur  within  PACAF  and  USAFE  because  vehicles  move 
around  frequently.  To  resolve  these  delays,  HQ  PACAF/USAFE 
has  put  a  liaison  office  at  Varner-Robins  ALC.  The  liaison 
office  has  a  computerized  tracking  database  system  for  all 
vehicles  assigned  to  the  two  commands  (installed  and  opera¬ 
tional  since  1985) .  The  new  computer  system  enhanced  the 
older  manual  efforts  by  reducing  the  location  time  from 
months  to  days.  The  computer  system  also  resulted  in  get¬ 
ting  safety  recalls  installed  sooner  to  reduce  the  risk  of 
accidents. 

Question  9.  The  half-ton  pickup  truck  parts  are  made 
by  the  manufacturers  for  ten  years  (by  U.S.  law).  Most  man¬ 
ufacturers  have  gone  ahead  to  make  parts  for  20  years.  The 
USAF  does  not  stock  parts  for  each  model  year  of  pickup 
truck.  The  commercial  market  place  demands  yearly  config¬ 
uration  changes.  The  USAF  salvages  the  trucks  after  the 
system  has  met  mileage  or  about  ten  years  of  service  re¬ 
quirements  and  is  replaced  with  a  new  model. 

Question  10.  Since  the  half-ton  pickup  trucks  are  re¬ 
placed  about  every  ten  years  and  parts  are  readily  avail¬ 
able,  configuration  changes  to  the  trucks  have  the  same  im¬ 
pact  as  other  types  of  COTS  systems. 

Question  1 1 .  Yes.  The  half-ton  pickup  trucks  going 
overseas  require  special  corrosion  treatment  (to  reduce  the 
effects  of  sea  spray).  Truck  transportation  to  CONUS  bases 
frequently  dent  the  exterior  surfaces,  and  USAF  personnel 
accept  faulty  products  by  prematurely  signing  the  DD  250  ac¬ 
ceptance  form.  Varner-Robins  ALC  has  advised  organizational 
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units  to  make  more  thorough  inspections  to  prevent  accep¬ 
tance  of  faulty  trucks. 


Question  12.  The  half-ton  pickup  truck  was  engineered 
to  last  and  has  a  proven  track  record  for  superior  technolo¬ 
gy.  There  is  little  else  to  say  to  complement  these  CQTS 
items. 

Question  13.  It  is  hard  to  say.  The  USAF  bought  suf¬ 
ficient  quantities  of  half-ton  pickup  trucks  to  support  op¬ 
erational  requirements.  However,  the  USAF  should  include 
Japanese  trucks  in  the  product  mix  because  of  their  proven 
dependability  record.  The  Japanese  Toyota  pickup  truck  sur¬ 
passes  many  American  made  pickup  trucks  manufactured  over 
the  last  25  years.  No  comments  were  made  about  buying  other 
types  of  COTS  systems. 

Question  14.  Yes.  An  advantage  of  buying  COTS  for 
many  government  agencies  at  a  central  agency  (such  as  the  at 
the  General  Services  Administration  (GSA)  and  at  U.S.  Army 
TACOM  for  vehicles)  are  the  economies  of  scale.  A  disadvan¬ 
tage  of  buying  COTS  pickups  are  the  higher  costs  charged  by 
the  manufacturer  for  the  custom  colors  (eight  to  ten  percent 
higher  for  Strata  Blue  and  camouflage  paint). 

Question  15.  Yes.  Budget  cuts  have  already  placed  a 
moratorium  on  buying  new  general  purpose  vehicles  (which  in¬ 
cludes  the  half  ton  pickup  trucks)  for  FYs  1991  and  1992. 

The  moratorium  does  not  apply  towards  special  purpose  vehi¬ 
cles.  Any  future  budget  cuts  will  require  the  USAF  to  cut 
order  quantities. 


Snow  Blower. 


Question  1 .  The  snow  blower  is  a  multi-purpose  vehi¬ 
cle  with  two  plow  attachments,  and  blower  and  cutter  heads. 
The  snow  blower  was  awarded  its  initial  contract  in  June 
1989.  The  600  to  700  snow  blowers  that  will  be  acquired  by 
USAF  will  support  northern  tier  bases  for  HQ  SAC,  PACAF,  the 
Alaskan  Air  Command,  USAFE,  and  ANG  bases  in  the  CONUS. 

Question  2.  No.  The  system  was  not  modified  for  go¬ 
vernment  use.  The  only  government  requirement  was  the  ”com- 
merciality  clause”  that  was  included  in  the  request  for  pro¬ 
posal  (KFP) .  The  snow  blower  had  to  be  available  in  the 
commercial  marketplace  for  12  months  before  the  USAF  could 
buy  for  USAF’s  applications.  This  clause  protects  the  USAF 
from  the  possibility  of  a  lack  of  spare  parts  because  the 
system  is  not  established  in  the  commercial  market  place. 
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Question  3.  The  snow  blower  will  receive  organic  lo¬ 
gistics  support  at  the  organizational  level  and  CLS  at  the 
depot  level.  The  bases  will  do  some  yearly  standardized  re¬ 
pairs  under  the  ’’Summer  Rebuild  Program.”  Normally,  only 
limited  technical  inspections  will  be  accomplished  by  the 
base  to  determine  whether  to  send  the  snow  blowers  back  to 
the  factory  for  repairs.  The  parts  are  supplied  by  contrac¬ 
tor  operated  parts  supplies  both  in  the  CONUS  and  overseas 
contractor  operated  parts  stores. 

Question  4.  The  maintenance  support  for  the  old  snow 
blowers  have  experienced  some  problems  due  to  the  systems’ 
age.  No  major  acquisition  has  been  made  since  the  early 
1960s.  The  oldest  system  is  52  years  old.  Some  snow  blow¬ 
ers  were  remanufactured  three  or  four  times.  Now  the  aging 
fleet  is  experiencing  metal  fatigue  (similar  to  old  military 
aircraft  air  frames) .  The  300  new  multi-purpose  snow  blow¬ 
ers  will  greatly  improve  the  maintenance  support  for  these 
older  systems. 

Question  5.  The  snow  blower  will  use  factory  commer¬ 
cial  manuals.  The  USAF  is  waiting  on  the  final  analysis  re¬ 
port  on  these  manuals  by  USAF  personnel.  The  system  is  in 
the  preliminary  stages  of  the  critical  design  review.  The 
USAF  expects  to  receive  updates  regularly  based  on  informa¬ 
tion  in  the  program  document  <PD>  . 

Question  6.  No.  The  snow  blower  presented  no  unusual 
interface  problems.  The  snow  blower  is  unique  to  the  USAF, 
but  commercial  firms  such  as  Emery  Air  Freight  and  Federal 
Express  have  shown  some  interest  in  buying  the  exact  same 
model.  There  is  a  provision  in  the  acquisition  contract  to 
deal  with  unique  kits  for  special  applications. 

Question  7.  The  acquisition  contract  obligates  the 
contractor  to  provide  maintenance  training  to  USAF  personnel 
on  the  snow  blower  in  the  future.  The  commercial  technical 
data  is  expected  to  be  self-explanatory  to  USAF  vehirle 
maintenance  personnel.  It  is  too  early  to  determine  if  the 
training  will  be  sufficient. 

Question  8 .  Yes.  Critical  failure  parts  will  be  easi¬ 
ly  accessible  for  the  snow  blower.  Contractor  operated 
parts  stores  will  supply  spares  in  the  CONUS  and  overseas 
(COPARS  and  COPAS) .  No  delays  are  expected  because  of  the 
proven  track  record  of  the  COPARS  and  COPAS  operations. 

Question  9.  No  configuration  changes  are  ejected  •<  - 
cause  the  snow  blower  will  be  commeriially  unique. 

Question  10.  Ccnfigurai ion  changes  to  She  snow  blower 
will  be  accomplished  manually  at.  the  Warner-Robins  ALC .  The 
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contract  requires  engineering  changes  to  be  approved  by  the 
USAF  prior  to  implementation. 

Question  11.  No.  There  are  no  PHS&T  problems  with  the 
snow  blower  because  the  system  is  too  new. 

Question  12.  The  USAF  should  simplify  the  acquisition 
process  for  the  snow  blower  by  limiting  the  organization  to 
use  only  the  advertised  functional  attachments.  With  the 
snow  blower,  the  USAF  permitted  the  RFP  to  add  attachments 
not  offered  in  the  vendor’s  commercially  available  model. 

Question  13.  Yes.  The  USAF  should  buying  more  snow 
blowers.  Other  COTS  systems  should  be  evaluated  to  stay 
within  budget  constraints  when  replacing  older  systems. 

Question  14.  Yes.  Several  advantages  when  buy  COTS 
include  economies  of  scale,  ease  of  support,  ease  of  pur¬ 
chase,  and  readily  available  parts.  No  comment  was  made 
about  disadvantages  when  buying  COTS. 

Question  15.  Yes.  However,  manpower  cuts  at  the  or¬ 
ganizational  level  that  supports  the  snow  blower  can  adapt 
more  easily  than  other  USAF  organizations  can  with  budget 
cuts. 


Sentinel-Bright  II  Computer  System. 

Question  1.  The  Sentinel-Bright  II  intelligence  train¬ 
ing  system  uses  several  commercially  available  types  of 
hardware  and  software  components  that  will  interface  with 
COMSEC  GFE  at  Goodfellow  AFB  TX.  The  system  will  support 
the  USAF  and  other  DoD  activities. 

Question  2.  Yes.  Substantial  portions  of  the  Senti¬ 
nel-Bright  II  system  are  COTS  hardware  and  software.  The 
remaining  portions  are  COMSEC  GFE.  The  contractor  is  deal¬ 
ing  with  the  TEMPEST  requirements  to  change  and  interface 
the  existing  COTS  hardware  and  software  into  the  GFE. 

Question  3.  The  Sentinel-Bright  II  will  only  have  CL S 
at  the  organizational  and  intermediate  levels.  The  CLS  con¬ 
tract  will  last  five  years  from  the  initial  operational 
date.  There  is  potential  for  more  than  one  hardware  and 
software  contractor,  but  the  USAF  would  normally  like  sin¬ 
gular  management  by  one  contractor  (the  software  CLS  con¬ 
tract  will  be  awarded  in  FY  91).  The  CLS  contract  gives  the 
contractor  the  freedom  to  remove  broken  parts  and  send  to  a 
local/intermediate  repair  facility. 
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Question  4.  The  Sentinel-Bright  II  computer  system  is 
too  new  to  assess  the  maintenance  support  concept. 

Question  5.  The  Sentinel-Bright  II  computer  system 
uses  a  combination  of  MIL-SPEC  drawings  with  commercial 
technical  data.  The  USAF  will  give  the  CLS  contractor  the 
flexibility  to  upgrade  the  commercial  data  and  to  update 
commercial  drawings/manuals  as  required.  The  USAF  is  trying 
something  new  and  innovative  with  this  Sentinel-Bright  II 
system.  Technical  interfacing  data  will  be  extracted  from 
magnetic  media  similar  to  CAD/CAM  software  programs  to  up¬ 
date  changes  to  the  system.  To  resolve  design  problems  with 
the  interfacing  of  MIL-SPEC  systems  to  the  COTS  equipment, 
the  USAF  had  detailed  design  reviews  with  the  contractor. 
Magnetic  media  (such  as  floppy  disks)  were  used  to  resolve 
compatibility  problems. 

Question  6.  Yes.  The  Sentinel-Bright  II  computer  sys¬ 
tem  was  integrated  into  COMSEC  GFE  and  into  a  specially 
built  TEMPEST  building  at  Goodfellow  AFB  TX.  The  prime  con¬ 
tractor  did  the  interfacing  work.  The  system  is  unique  to 
the  USAF,  but  the  system  could  be  expanded  to  train  other 
DoD/civilian  personnel  at  other  schools.  The  primary  inte¬ 
gration  problems  occurred  with  the  TEMPEST  issues  and  how  to 
determine  what  type  of  installation  standards  to  use  (MIL- 
SPEC  or  ANS I /commercial ) . 

Question  7.  Training  for  the  Sentinel-Bright  II  com¬ 
puter  system  will  be  provided  by  the  vendor  to  a  government 
cadre.  Then,  the  government  cadre  will  provide  training  to 
other  government  personnel.  It  is  too  early  to  determine  if 
the  training  will  be  sufficient. 

Question  8.  Yes.  MIL-SPEC,  parts  for  the  Sentinel- 
Bright  II  computer  system  may  cause  more  problems  than  the 
COTS  parts.  The  commercial  parts  support  will  be  placed  at 
the  mercy  of  the  prime  contractor.  There  is  potential  for 
some  delays  in  getting  parts  because  the  system  is  still  in 
development . 

Question  9.  The  Sentinel-Bright  II  computer  system 
will  have  a  minimal  investment  in  spares.  So,  configuration 
changes  will  have  little  impact  on  spares  for  the  system. 

The  USAF  has  several  choices  to  go  to  different  suppliers  to 
satisfy  equipment  requirements.  To  alleviate  problems  with 
equipment  availability,  the  USAF  may  substitute  some  common 
equipment  like  video  displays,  computers,  or  disk  drives. 
Some  minor  problems  in  the  software  need  fine  tuning  by  the 
contractor . 

Question  10.  The  USAF  uses  a  support  group  to  closely 
monitor  the  installation  and  development  of  the  Sentinel- 
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Bright  II  computer  system.  There  is  some  flexibility  to  go 
to  multiple  suppliers.  Engineering  drawings  are  clear  and 
keep  the  configuration  controlled  mutually  between  the  con¬ 
tractor  and  the  USAF. 

Question  11.  Yes.  The  Sentinel-Bright  II  computer 
system  required  special  facilities  to  be  built  to  house  the 
system.  The  system  was  built  from  scratch  to  support  over 
400  student  positions  to  be  located  within  the  facility.  No 
other  PHS&T  problems  have  been  encountered  to  date. 

Question  12.  The  USAF  should  have  developed  the  tech¬ 
nical  manuals  for  the  Sentinel-Bright  II  computer  system 
earlier  (it  took  two  to  three  years  to  get  them  from  the 
start  of  the  program).  Otherwise,  the  system  is  too  new  to 
make  additional  recommendations. 

Question  13.  Yes.  Buying  COTS  equipment  to  interface 
with  GFE  for  the  Sentinel-Bright  II  computer  system  sped  up 
the  buying  process.  If  the  system  contained  pure  COTS,  the 
USAF  could  not  meet  all  of  the  military  needs  of  the  train¬ 
ing  system. 

Question  14.  Yes.  The  primary  advantage  of  buying 
COTS  systems  is  that  it  speeds  fielding  USAF  programs.  The 
principle  disadvantage  of  buying  COTS  equipment  happens  when 
the  USAF  compromises  performance  standards  to  interface  COTS 
into  government  developed  systems.  When  this  compromising, 
occurs  by  tailoring  the  overall  system  to  government  speci¬ 
fications,  the  USAF  will  get  less  performance  than  what  is 
needed . 

Question  15.  Yes.  Budget  cuts  will  affect  the  avail¬ 
ability  of  the  Sent ine 1 -Br ight  II  computer  system.  CLS  is 
set  up  to  support  numerous  systems,  and  the  CLS  is  spread 
across  many  programs.  So  the  budget  cuts  will  not  be  felt 
nearly  as  hard  as  if  the  CLS  contractor  was  just  supporting 
this  program. 


Scope  Shield  Land  Mobile  Radio  System. 

Question  1 .  The  Scope  Shield  Land  Mobile  Radio  (LMR) 
system  provides  ultra-high  frequency  <UHF>  two-way  communi¬ 
cations  for  USAF,  ANG,  and  USAFR  security  police  forces  as¬ 
signed  to  Weapon  Systems  Security  and  Base  Ground  Defense 
missions  in  deployed  wartime  missions.  Over  4000  radios 
were  purchased  from  Magnavox  to  provide  the  worldwide  mis¬ 
sion.  The  radio  uses  a  multiple  band  frequency  hopping 
technique  to  foil  enemy  electronic  jamming.  The  radios  may 
be  modified  for  encryption  by  using  plug-in  KY  crypto  chips 
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The  encryption  will  provide  additional  operation  security 
for  the  security  police  forces. 

Question  2.  No.  The  Scope  Shield  LMR  was  developed 
solely  by  the  vendor  to  meet  their  perception  of  what  would 
be  a  marketable  UHF  hand  held  (portable)  radio.  Magnavox’ s 
military  version  has  some  features  which  would  not  be  needed 
by  commercial  users.  So,  the  commercial  version  is  designed 
to  have  less  functions  than  its  military  counterpart.  Cui — 
rently  Magnavox  has  not  sold  the  radio  to  the  public. 

Question  3.  The  Scope  Shield  LMR  does  not  use  CLS  at 
the  organizational  level.  At  the  organizational  level,  the 
radios  are  repaired  organically  by  removing  and  replacing 
(R&R)  modular  components.  If  the  repair  action  is  beyond 
the  technical  capability  of  the  organizational  unit,  the  ra¬ 
dio  is  sent  to  the  factory  for  depot  overhaul/repair.  Mag¬ 
navox  maintains  100%  factory  CLS  for  depot  overhauls/repairs 
because  they  maintain  special  depot  test  equipment,  manuals, 
and  supplies. 

Question  4.  The  Scope  Shield  LMRs’  source  of  repair 
(S&R)  was  made  late  relative  to  the  availability  of  the  op¬ 
erational  radios.  The  production  contract  did  not  include 
resources  for  depot  activation.  The  system  program  office 
(SPO)  assumed  the-  program  would  be  using  total  organization¬ 
al  CLS.  However,  Sacramento  ALC  elected  to  use  organic  lo¬ 
gistics  support.  The  depot  spares,  technical  manuals,  and 
support  equipment  were  late  as  a  result  from  this  mix  up  in 
the  decision  for  logistics  support.  Some  delays  to  field 
additional  radios  were  caused  by  the  additional  lead  time 
required  to  modify  the  contract  to  buy  depot  spares.  This 
initial  problem  resulted  in  fielding  some  radios  without 
full  logistics  support  while  the  integrated  logistics  sup¬ 
port  <ILS)  resources  were  being  negotiated. 

Question  5.  Commercial  technical  manuals  are  adequate 
for  the  Scope  Shield  LMR  equipment.  Proprietary  rights  re¬ 
side  with  the  vendor,  therefore,  the  manuals  are  not  part  of 
a  reprocureraent  package.  The  manuals  get  updated  only  if 
the  equipment  is  upgraded  by  the  USAF  or  by  the  original 
equipment  manufacturer  (OEM)  (no  one  can  get  the  changes  due 
to  the  contractual  agreements).  The  biggest  problem  with 
the  manuals  is  their  coverage  of  the  LRU  spares.  The  spares 
are  bought  sole  source  because  of  the  proprietary  rights 
granted  to  the  original  vendor,  Any  future  changes  to  the 
equipment  for  the  LRU  spares  will  also  require  increasing 
the  sole  source  funding  to  change  the  manuals  at  all  world¬ 
wide  locations. 

Question  6.  Yes.  The  Scope  Shield  LMR  was  integrated 
into  USAF  security  police  vehicles  for  mobile  applications. 
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The  USAF  base  motorpools  had  no  problems  fabricating  in¬ 
stallation  kits  to  use  the  portable  radios  in  security  po¬ 
lice  vehicles.  The  radio  is  unique  to  the  USAF,  but  the 
U.S.  Army  is  considering  buying  some  of  the  next  version  of 
this  radio  (phase  II). 

Question  7.  The  Scope  Shield  LMR  uses  on-the-job 
training  (OJT)  at  the  organizational  level  for  USAF  security 
police  personnel.  The  training  is  simple  because  the  radios 
are  user  friendly.  Currently,  there  are  no  problems  with 
the  training. 

Question  8.  Yes.  The  critical  failure  parts  for  Scope 
Shield  LMRs  are  located  at  the  organizational  level.  The 
USAF  provisioned  organizational  spares  to  fill  the  initial 
supply  support  levels  (ISSLs)  and  war  reserve  material  (VRM) 
requirements.  When  the  program  began  fielding  initial 
units,  contractual  problems  arose  concerning  organizational 
spares  that  resulted  in  delivery  of  radios  to  units  without 
spares.  The  leadtiroe  to  provision  the  spares  was  greater 
than  the  production  time  for  the  radios.  Some  streamlining 
for  provisioning  the  line  replaceable  units  (LRUs,  modular 
components)  had  to  be  done  in  weeks  rather  than  the  normal 
lead  time  of  12  to  18  months. 

Question  9.  The  spare  parts  will  not  impact  the  con¬ 
figuration  control  for  the  Scope  Shield  LMRs.  Since  the 
USAF  is  the  main  (only)  customer  for  the  LMRs,  the  next  gen¬ 
eration  of  equipment  is  significant  enough  that  this  first 
generation  LMR  will  not  get  any  enhancements  that  will 
change  its  original  configuration. 

Question  10.  The  Scope  Shield  LMR  has  not  had  any  con¬ 
figuration  changes.  USAF  managers  are  not  expecting  any 
configuration  changes  because  the  next  generation  radio 
based  on  this  model  is  totally  changed  such  that  the  USAF 
model  can  not  be  modified  to  receive  the  new  enhancements. 

Question  11.  No.  The  Scope  Shield  LMR  does  not  have 
any  PHS&T  problems  nor  any  facility  problems.  The  radios 
are  rugged  portable  units  designed  for  outside  use  by  secur¬ 
ity  police. 

Question  12.  The  Scope  Shield  LMR  experienced  some 
program  errors  at  the  USAF  SPO  because  of  oversight.  Depot 
spares  should  have  been  provisioned  in  the  initial  contract. 
The  SPO  learned  their  lesson  and  have  included  the  depot 
provisioning  process  in  newer  contracts. 

Question  13.  No.  The  USAF  should  have  waited  to  buy 
the  next  generation  model.  The  next  generation  is  being 
qualified  now.  The  USAF  should  buy  COTS  systems  for  other 
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programs  that  use  equipment  such  as  computers  because  they 
can  be  applied  to  any  mission  with  creative  approaches. 

Question  14.  Yes.  The  main  advantage  of  buying  COTS 
is  to  get  the  latest  technology  cheap  and  fast.  The  govern¬ 
ment  can  plan  to  replace  COTS  more  frequently  because  we 
will  not  have  to  spend  a  lot  of  research  and  development 
money.  COTS  has  a  disadvantage  because  the  USAF  may  falsely 
assume  investment  money  will  be  available  because  the  USAF 
will  save  money  in  another  appropriation’s  R&D  which  is  not 
feasible.  The  support  system  for  COTS  needs  to  be  innova¬ 
tive  and  flexible.  Phase  provisioning  such  as  high  speed 
provisioning  of  LRUs  and  depot  parts  is  needed.  Stronger 
consideration  should  be  given  to  CLS  to  reduce  investment 
costs  and  the  time  to  set  up  support  (to  allow  economical 
analyses  to  be  performed) .  USAF  personnel  need  to  get  used 
to  using  more  COTS  type  manuals  and  training.  During  the 
acquisition  phase,  life  cycle  system  management  for  COTS 
must  give  more  consideration  to  the  potential  users  and 
supporters. 

Question  15.  No.  Budget  and  manpower  cuts  will  not 
affect  the  logistics  support  for  Scope  Shield  LMRs. 


CCPDS-R  (Replacement)  Computer  System. 

Question  1.  The  CCPDS  Replacement  (CCPDS-R)  computer 
system  is  replacing  the  missile  warning  computers  and  con¬ 
soles  in  Cheyenne  Mountain  AFB,  the  worldwide  display  tei — 
minals  (VDTs)  at  24  worldwide  locations  for  commander  in 
chief  (CINC)  assessments,  and  the  SAC  force.  management/Force 
Survival  subsystems  at  Offutt  AFB,  NE.  Users  include 
USSPACECOM,  SAC,  CINCEUR,  CINCPAC,  Office  of  the  Joint 
Chiefs  of  Staff  (OJCS),  CINCLANT,  and  Canada.  The  equipment 
is  pure  COTS  except  for  the  consoles  that  were  fabricated  to 
hold  the  equipment.  The  system  includes  COTS  software  and 
approximately  one  million  lines  of  ADA  computer  code. 

Question  2.  No.  The  CCPDS-R  computer  system  contains 
pure  COTS  hardware  and  software  except  the  consoles  to  hold 
the  equipment. 

Question  3.  The  CCPDS-R  computer  system  is  vendor  sup¬ 
ported  at  the  depot  level  through  the  vendor’s  facilities. 
The  USAF  maintains  the  equipment  with  organic  logistics  sup¬ 
port  at  the  organizational  level. 

Question  4.  Much  of  the  equipment  the  CCPDS-R  will  be 
replacing  has  become  insupportable  due  to  its  long  service 
life,  and  because  the  vendors  will  (can)  no  longer  support 
it.  So,  AFLC  was  forced  to  perform  limited  reverse 
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engineering  or  seek  alternative  equipment  if  possible.  By 
using  the  CCPDS-R  COTS  equipment,  the  overall  maintenance 
support  concept  will  improve  for  this  system. 

Question  5.  The  CCPDS-R  computer  system  uses  commer¬ 
cial  manuals  to  the  maximum  extent.  Drawings  for  the  COTS 
equipment  are  considered  to  be  under  level  1 1  source  con¬ 
trol .  The  commercial  drawings  are  adequate  for  all  users  of 
the  system  except  the  AFLC  support  activities.  The  drawings 
are  adequate  and  in  accordance  with  the  contractor’s  speci¬ 
fications,  but  the  AFLC  air  logistics  center  <ALC)  is  asking 
for  specification  control  drawings  for  the  COTS  equipments. 
The  largest  problem  with  this  additional  requirement  is  that 
the  USAF  will  not  provide  the  funding  to  buy  the  extra  draw¬ 
ings.  The  drawings  are  updated  by  the  vendor  through  updat¬ 
ed  microfiche.  Ninety-five  percent  of  the  commercial  manu¬ 
als  for  the  CCPDS-R  use  microfiche. 

Question  6.  Yes.  The  CCPDS-R  computer  system  was  in¬ 
tegrated  into  other  systems  inside  the  Cheyenne  Mountain 
Complex  (CMC) ,  Offutt  AFB,  and  the  regional  CINCs’  command 
centers.  The  primary  interfacing  effort  focused  on  install¬ 
ing  the  new  system  into  preexisting  facilities.  The  prime 
contractor  installed  the  CCPDS-R  based  on  information  sup¬ 
plied  by  the  government  and  other  contractors.  The  system 
is  uniquely  configured  for  the  USAF,  but  the  equipment  is 
not  unique  to  the  USAF.  No  problems  have  been  encountered 
with  the  integration  effort. 

Question  7,  System  training  for  the  CCPDS-R  computer 
system  will  be  developed  by  the  prime  contractor.  By  inte¬ 
grating  existing  commercial  information  about  the  system’s 
hardware  and  software,  the  contractor  will  provide  training 
to  system  maintenance  personnel,  system  security  staff,  and 
combat  crew  operators.  The  training  will  be  essential  to 
keep  the  system  operational.  The  training  contract  has  not 
begun  development  yet,  therefore,  it  is  too  early  to  detei — 
mine  if  the  training  will  be  sufficient. 

Question  8.  Yes.  The  critical  failure  parts  for  the 
CCPDS-R  computer  system  will  be  easily  accessible  at  the 
organizational  level.  The  spare  parts  will  be  purchased 
through  commercial  vendors  by  AFLC.  There  are  no  problems 
to  date  caused  by  critical  failure  parts. 

Question  9.  Until  the  USAF  configuration  control 
boards  (CCBs)  approve  the  change,  there  is  the  possibility 
that  hardware  (i.e.  unapproved  circuit  boards)  could  be 
shipped  to  the  field  by  the  vendor.  There  is  very  little 
guidance  for  disposition/modification  instructions  concern¬ 
ing  the  spares  that  become  obsolete  as  a  result  of  a 
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conf igurat ion  change.  There  has  not  been  any  configuration 
changes  made  to  the  system  to  date. 

Question  10.  The  CCPDS-R  computer  system  has  not  ex¬ 
perienced  any  configuration  changes,  but  all  configurational 
changes  must  be  approved  by  the  configuration  control  boards 
<CCBs)  . 

Question  11.  No.  The  CCPDS-R  computer  system  does  not 
have  any  PHS&T  problems  nor  any  facility  problems. 

Question  12.  The  USAF  should  freeze  the  baseline  for 
spares  for  the  CCPDS-R  computer  system.  By  freezing  the 
baseline,  the  USAF  could  prevent  configuration  changes  from 
occurring  that  would  otherwise  make  spares  useless.  Also, 
the  vendors  should  be  required  to  ship  preapproved  revisions 
for  newer  configurations  to  the  USAF  before  payment  is  made. 
This  procedure  would  prevent  the  vendor  from  updating  the 
equipment  without  the  consent  of  the  USAF  and  to  prevent 
’’dumping"  of  parts. 

Question  13.  Yes.  The  advantages  of  buying  COTS  cer¬ 
tainly  outweigh  the  disadvantages.  The  advertised  advanta¬ 
ges  of  buying  COTS  negate  the  impacts  of  constant  configura¬ 
tion  changes  by  the  COTS  vendor.  COTS  is  useful  for  most 
applications,  but  ruggedizat ion  is  a.  major  concern. 

Question  14.  Yes.  The  primary  advantages  of  buying 
COTS  are  shorter  acquisition  time  and  existing  commercial 
basis  for  support. 

Question  15.  Yes.  Manpower  cuts  for  the  CCPDS-E  com¬ 
puter  system  may  not  have  much  impact  because  the  USAF  is 
already  having  trouble  filling  positions  in  the  initial 
training  classes  for  the  system’s  USAF  technicians  and  op¬ 
erators.  Budget  cuts  and  reallocations  have  already  im¬ 
pacted  the  program  twice  by  slipping  the  completion  time. 
Additional  budget  cuts  will  slip  the  completion  time  even 
f  urther . 


Granite  Sentry  Computer  System. 

Question  1.  The  Granite  Sentry  computer  system  is  com¬ 
pletely  COTS.  It  replaces  older  stand  alone  computer  sys¬ 
tems  at  the  Cheyenne  Mountain  Complex  (CMC)  for  CONUS  air 
defense  that  became  obsolete  in  1988.  The  Granite  Sentry 
computer  system  is  also  a  part  of  an  integrated  defense 
system  that  supports  USSPACECOM,  Peterson  AFB,  and  the  CMC, 

Question  2,  Yes.  The  Granite  Sentry  computer  system 
will  replace  all  of  the  427M  systems  at  the  CMC  by  1995. 
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The  system  is  a  combination  of  COTS  equipment  purchased  from 
Digital  Equipment  Corporation  (DEC).  The  USAF  will  coordi¬ 
nate  subsequent  actions  to  integrate  the  equipment  and  soft¬ 
ware  into  the  CMC  as  a  government  air  defense  system.  Some 
of  the  software  is  being  modified  at  USSPACECOM  by  USAF  pro¬ 
gramming  personnel  for  use  in  the  system. 

Question  3.  The  Granite  Sentry  computer  system  cur¬ 
rently  uses  organic  logistics  support  at  the  organizational 
level  and  interim  contractor  support  (ICS)  for  depot  level 
repairs  to  maintain  the  system  through  April  1991.  Depot 
CLS/ICS  will  keep  the  system  operational  from  April  1991  un¬ 
til  date  of  the  program  management  requirements  turnover 
(PMRT,  the  transfer  of  the  program  from  AFSC  to  AFLC  and  the 
operational  command).  The  CLS  contractor  will  replace  all 
faulty  LRUs  and  system  replaceable  units  (SRUs) .  Currently, 
Digiral  Equipment  Corporation  repairs  all  parts  that  fail 
within  the  manufacturer’s  90  day  warrantee.  Lockheed  per¬ 
forms  the  depot  level  repairs  under  a  three  year  CLS  con¬ 
tract  that  has  options  for  renewal.  The  initial  CLS  depot 
contract  being  recommended  by  the  ILSM  could  revert  to  the 
manufacturer  DEC  at  PMRT. 

Question  4.  Since  the  system  is  brand  new,  there  is  no 
change  in  the  maintenance  support  concept.  The  ICS,  organic 
logistics  support,  and  factory  warrantee  is  adequate. 

Question  5.  The  Granite  Sentry  computer  system  uses 
commercial  manuals.  The  systems  manuals  are  being  evaluated 
for  USAF  technical  order  specifications,  otherwise,  all 
other  manuals  will  remain  commercial.  The  commercial  manu¬ 
als  are  adequate.  The  commercial  manuals  are  updated 
through  a  yearly  subscription  service.  There  are  no  signi¬ 
ficant  problems  with  the  commercial  manuals. 

Question  6.  Yes.  The  Granite  Sentry  computer  system 
is  being  installed  in  phases.  Phase  one  has  been  completed 
(replacing  the  427M  workstations) .  The  modernizat ion  pro¬ 
gram  required  no  major  modifications  to  existing  equipment. 
The  hardware  is  not  unique  to  the  USAF,  but  the  software  is. 
The  USAF  is  performing  the  integration/installation  effort. 
The  commercially  standardized  equipment  and  software  helped 
integrate  the  program  easily  into  the  USAF’ s  preexisting 
equipment . 

Question  7.  Training  for  the  Granite  Sentry  computer 
system  will  be  developed  and  provided  by  the  vendor  (SDAS 
Corp.  )  .  The  vendor  will  train  all  USAF  operations  person¬ 
nel,  initial  maintenance  cadre  staff,  and  USSPACECOM  train¬ 
ing  staff.  The  USSPACECOM  training  staff  will  provide  all 
follow-on  operations  training  after  the  initial  vendor 
training  ends.  Digital  Equipment  Corporation  agreed  to 
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contracting  terms  to  train  23  maintenance  personnel  for  one 
year  for  $150,000  plus  government  temporary  duty  traveling 
expenses.  The  follow-on  maintenance  training  could  transfer 
to  a  ATC  classroom  or  by  contract  (to  be  determined) . 

Question  8.  Yes.  The  critical  failure  parts  for  the 
Granite  Sentry  computer  system  are  easily  accessible.  Un¬ 
til  1995,  the  parts  will  be  leased  from  the  vendor  by  the 
CLS  contractor.  Any  future  CLS  contractors  will  also  lease 
the  critical  spares  from  the  equipment  vendor.  To  alleviate 
possible  shortfalls  with  spares,  AFLC  will  do  some  provi¬ 
sioning  by  1993  before  PMRT. 

Question  9.  The  impact  of  configuration  changes  on 
spares  for  the  Granite  Sentry  computer  system  is  dependent 
upon  the  degree  of  the  revision  for  the  configuration 
change.  In  some  cases,  the  USAF  gets  revisions  that  are 
normally  cycled  with  the  repair  actions.  The  system  defi¬ 
nitely  remains  operational  after  these  changes  occur.  No 
problems  have  occurred  to  date. 

Question  10.  The  configuration  changes  that  are  made 
to  the  Granite  Sentry  computer  system  are  thoroughly  tested 
in-house  by  USAF  technical  staff  to  validate  the  change. 

When  USAF  personnel  are  satisfied  that  the  configuration 
change  will  not  degrade  the  mission,  the  change  may  be  im¬ 
plemented  throughout  the  system. 

Question  11.  No.  The  Granite  Sentry  computer  system 
does  not  have  any  PHS&T  problems.  The  vendor  (DEC)  trans¬ 
ported  the  new  equipment  to  our  USAF  sites  and  installed  the 
system  into  our  existing  facilities.  No  problems  were  en¬ 
countered  . 

Question  12.  The  USAF  should  get  a  prime  contractor 
for  systems  like  the  Granite  Sentry  computer  system.  There 
were  no  problems  with  the  COTS  equipment,  rather,  it  was 
USAF  rules  and  the  mind-set  thinking  about  how  we  develop 
programs  through  the  USAF  bureaucracy.  As  a  result  of  this 
way  of  doing  business,  programs  like  Granite  Sentry  are  more 
expensive  because  we  try  to  get  the  program  to  progress  like 
the  fully  developed  format.  The  USAF  needs  newer  rules  and 
definitions  to  handle  COTS  through  AFLC  and  Sacramento  ALC’s 
Technical  Data  Division.  With  systems  as  large  as  Granite 
Sentry,  it  may  not  be  cost  effective  to  continue  going  with 
COTS  until  these  changes  are  implemented. 

Question  13.  Yes.  The  USAF  should  buy  more  of  these 
COTS  systems.  However,  the  largest  concern  is  the  USAF’ s 
need  for  a  uniform  support  structure  for  dealing  with  COTS 
systems  and  equipment.  The  USAF  should  buy  other  types  of 
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COTS  equipment  such  as  electronic  video  equipment  because  it 
could  use  similar  contracts  developed  for  COTS  computers. 

Question  14.  Yes.  The  main  disadvantage  is  the  USAF’ s 
non-uniform  treatment  of  COTS  systems.  The  USAF  at  AFLC  and 
the  Sacramento  ALC  Technical  Data  Division  have  too  many 
people  who  are  trained  to  treat  COTS  systems  like  fully  de¬ 
veloped  systems.  This  treatment  slows  down  the  acquisition 
process  to  the  point  where  it  may  not  be  cost  effective  to 
use  COTS  when  the  process  takes  as  long  as  fully  developed 
systems. 

Question  15.  Yes.  Since  the  Granite  Sentry  computer 
system  is  being  implemented  in  phases,  the  USAF  can  end  the 
program  early  if  manpower  and  budget  cuts  are  significant. 
Otherwise,  larger  budget  cuts  will  have  detrimental  impacts 
on  the  supportabi 1 i ty  for  the  parts  of  the  system  that  have 
already  become  operational. 


Power  Conditioning  and  Continuation  Interfacing  Equipment. 

Question  1.  The  Power  Conditioning  and  Continuation 
Interfacing  Equipment  <PCCIE>  is  covered  by  two  five  year 
requirements  contracts  for  power  conditioners  with  Liebert 
corporation  and  uninterruptible  power  supplies  with  Exide 
Electronics.  There  are  75  models  ranging  in  power  ranges 
from  1  to  1000  KVA  <ki lo-vol t-amperes,  a  rating  of  1000 
watts  continuous  power) .  There  was  no  concept  development 
(Full  Scale  Development,  FSD>  phases  because  the  equipment 
had  been  on  the  commercial  market  (and  tested)  for  a  number 
of  years.  All  MAJCOMs  use  the  PCCIE  as  well  as  other  go¬ 
vernment  agencies  and  services.  Our  equipment  has  been  in¬ 
stalled  at  most  USAF  bases.  The  contract  is  1.5  years  old 
and  all  systems  are  still  covered  by  the  two  year  factory 
warrantee.  The  initial  PCCIE  contract  for  acquisition  and 
support  exceeds  $620  million. 

Question  2.  No.  The  PCCIE  was  not  modified  for 
government  use. 

Question  3.  The  PCCIE  has  depot  CLS  planned  for  the 
life  of  the  equipment.  The  system  has  only  minor  organic 
support  requirements  at  the  organizational  level.  If  the 
system  requires  significant  repairs,  the  item  is  removed  and 
sent  to  the  CLS  depot  (which  is  covered  by  a  five  year 
contract  that  will  be  recompeted  every  five  years). 

Question  4 ,  The  PCCIE  has  a  better  maintenance  sup¬ 
port  concept  than  prior  generations  of  equipment  because 
maintenance  support  was  included  on  the  contract  as  an 
optional  line  item.  The  maintenance  line  item  includes 


4 . 34 


maintenance  training  and  emergency  maintenance  for  the 
PCCIE. 


Question  5.  The  PCCIE  contract  offers  the  operating 
user  technical  manuals  as  a  line  item  (optional  selection 
with  the  equipment  order) .  The  commercial  manuals  are  ad¬ 
equate.  Technical  manual  changes  are  sent  by  the  manufact¬ 
urer  to  the  owning  organizations.  The  USAF  has  not  had  any 
problems  to  date  with  the  commercial  manuals. 

Question  6.  Yes.  The  PCCIE  is  part  of  the  power  qua¬ 
lity  system.  PCCIE  has  to  be  integrated  into  existing  com¬ 
puter  systems  in  pre-existing  facilities.  Also  PCCIE  has  to 
be  connected  into  generator  systems.  The  CLS  contractor  and 
the  government  perform  the  installation  and  integration. 
However,  the  full  installation  and  integration  is  a  line 
item  option  on  the  contract  to  allow  100%  contractor  in¬ 
stallation.  When  the  100%  contractor  installation  is  se¬ 
lected,  the  USAF  must  still  certify  and  accept  the  installa¬ 
tion  with  one  of  the  USAF’ s  QAE  personnel.  The  equipment 
configuration  is  not  unique  to  the  USAF.  No  major  problems 
have  been  encountered  to  date  with  the  systems’  integration 
into  existing  facilities  and  government  owned  equipment. 

Question  7.  Maintenance  training  for  the  PCCIE  is  pro¬ 
vided  by  the  contractor  to  USAF  and  government  personnel  who 
need  it.  The  training  is  a  line  item  option  that  is  select¬ 
ed  by  the  operational  base  to  avoid  a  yearly  maintenance 
contract  with  a  CLS  contractor.  The  training  is  adequate, 
and  there  are  no  problems  to  date. 

Question  8.  Yes.  The  critical  failure  parts  for  the 
PCCIE  have  been  provisioned  (Liebert  100%  and  Exide  is  being 
provisioned)  and  stock  listed  by  the  USAF.  Currently  the 
contract  is  too  new  to  detect  any  problems  with  support  for 
these  parts.  Organizational  users  also  have  spares  kits  lo¬ 
cated  as  forward  supply  points  with  the  PCCIE.  The  PCCIE 
has  been  on  the  market  so  long  that  USAF  managers  do  not  ex¬ 
pect  the  equipment  to  change  much.  However,  the  contract 
includes  wording  to  expand  the  number  of  line  items  to  in¬ 
clude  improved  models  when  they  become  available. 

Question  9.  The  PCCIE  has  not  experienced  any  con¬ 
figuration  changes  to  date. 

Question  10.  The  PCCIE  has  been  on  the  commercial 
market  for  a  long  time.  The  USAF  included  wording  on  the 
contract  to  allow  improved  models  to  expand  the  number  of 
line  items  on  the  contract.  The  additional  expansion  cap¬ 
ability  allows  government  managers  to  buy  state  of  the  art 
equipment  as  soon  as  it  becomes  available, 
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Question  1 1 .  Yes.  The  PCCIE  has  had  some  packaging 
failures  and  transportation  has  slowed  down  the  installation 
process.  The  contractor  had  to  replace  damaged  items  be¬ 
cause  he  was  liable  for  damages  to  the  new  equipment  before 
delivery  to  the  installation  sites.  The  transportation  pro¬ 
blems  centered  around  redirect  orders  <FDOs)  which  the  USAF 
resolved  by  having  USAF  transportation  offices  research  the 
delays  to  make  recommendations  for  further  improvements. 

Question  12.  No  response  was  made  for  this  question. 

Question  13.  Yes.  The  systems  have  been  extremely  re¬ 
liable  and  have  filled  a  critical  gap  in  the  USAF  power 
equipment  inventory.  The  USAF  should  buy  more  COTS  only  if 
the  systems  have  had  a  history  of  success  in  the  commercial 
market . 

Question  14.  No  response  was  made  for  this  question. 

Question  15.  No  and  yes.  The  PCCIE  will  not  have  any 
problems  due  to  budget  or  manpower  cuts  except  the  number  of 
additional  units  the  government  plans  to  field/buy  in  the 
future . 


Sentinel-Aspen  I  Computer  System, 

Question  1.  The  Sent inel -Aspen  I  computer  system  will 
only  be  used  in  one  location  at  Goodfellow  AFB  TX  to  moder¬ 
nize  intelligence  training  equipment  for  the  Air  Training 
Command  <ATC) . 

Question  2.  Yes.  The  Sentinel-Aspen  I  computer  sys¬ 
tem  is  nearly  100%  COTS  hardware.  Only  six  to  seven  circuit 
cards  were  modified  for  unique  government  requirements. 

Some  of  the  software  was  developed  for  specific  training  ap¬ 
plications.  All  other  software  was  COTS. 

Question  3.  The  Sent inel -Aspen  I  computer  system  is 
covered  by  a  one  year  CLS  contract  with  four  one  year  op¬ 
tions.  When  the  Sentinel-Aspen  I  system  is  completed,  the 
contract  will  be  awarded  for  five  years  and  will  be  renegot¬ 
iated  every  five  years  there  after.  All  Sentinel  COTS  sys¬ 
tems’  hardware  (including  Sent i ne 1 -Aspen ’ s )  are  covered  by  a 
single  CLS  contractor.  The  software  for  the  Sentinel  sys¬ 
tems  is  covered  by  a  another  CLS  contractor.  Conflicts  (oc¬ 
curring  from  problems  in  the  system)  between  the  hardware 
and  software  contractors  are  resolved  through  the  government 
site  representative  (a  government  computer  specialist  from 
the  local  USAF  commun i ca t i ons  squadron). 
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Question  4.  The  Sentinel-Aspen  I  computer  system  has 
not  had  any  maintenance  support  problems  with  the  CLS. 

Question  5.  The  USAF  did  not  purchase  any  equipment 
drawings  for  the  Sentinel-Aspen  I  computer  system.  The  CLS 
contract  requires  the  software  contractor  to  subscribe  to  a 
microfiche  commercial  manual  service  from  the  equipment 
vendor  (DEC) .  The  CLS  contract  also  requires  the  hardware 
contractor  to  use  LRU  diagnostics  in  the  system  and  product 
equipment  manuals  (required  to  be  purchased  and  maintained 
by  the  contractor  at  his  cost).  Vhen  neither  contractor  can 
resolve  complex  equipment/software  problems,  the  contract 
requires  the  contractor  to  contact  the  original  equipment 
manufacturer  (OEM)  to  solve  the  problems  at  the  contractors' 
expense.  The  contractors  are  required  to  maintain  the  sys¬ 
tem  at  a  95%  effectiveness  rate  with  the  available  technical 
data.  If  the  effectiveness  rate  falls  below  the  95%  rate, 
the  contract  allows  the  government  to  withhold  a  percentage 
of  the  contractors’  monthly  billing  as  a  penalty.  The  CLS 
contractor  may  also  have  to  maintain  and  stock  spares  to 
meet  the  95%  rate. 

Question  6.  Yes.  The  Sentinel-Aspen  I  computer  sys¬ 
tem  was  integrated  into  a  government  facility.  The  govern¬ 
ment  facility  was  designed  and  built  to  hold  the  Sentinel- 
Aspen  I  system.  Some  interfacing  is  on-going  with  other 
Sentinel  intelligence  training  systems.  The  government  ci¬ 
vil  faci.lity  engineers  did  the  site  preparations  because  it 
was  cheaper  than  contracting  out  this  requirement.  System 
architecture  was  done  by  an  installation  contractor  diffei — 
ent  than  either  CLS  contractor  or  the  original  equipment 
manufacturer  (OEM).  The  Sentinel-Aspen  I  system  is  a  unique 
system  to  the  USAF,  but  the  equipment  is  not.  No  signifi¬ 
cant  problems  were  encountered  during  and  after  the  integra¬ 
tion  efforts. 

Question  7.  CLS  personnel  were  required  to  be  trained 
before  the  USAF  awarded  the  contract  to  the  CLS  contractor. 
If  the  OEM  or  USAF  make  future  enhancements  to  the  Sentinel- 
Aspen  I  computer  system,  training  will  be  provided  to  the 
CLS  contractor  on  a  reimbursement  basis. 

Question  8.  The  critical  failure  parts  are  easily  ac¬ 
cessible  for  the  Sentinel-Aspen  I  computer  system.  DEC  (the 
OEM)  wanted  to  win  the  hardware  CLS  contract,  but  DEC'S  bid 
was  significantly  more  expensive  than  the  current  CLS  con¬ 
tractor.  DEC  lost  the  CLS  contract,  and  refused  to  supply 
the  parts  to  the  CLS  contractor  for  repairs  on  the  Sentinel- 
Aspen  I  system.  The  CLS  contractor  was  forced  to  pay  more 
for  parts  by  going  to  a  third  party  vendor.  However,  the 
USAF  will  only  pay  the  CLS  contractor  GSA  list  price  foi  the 
spares.  The  CLS  vendor  may  ask  the  USAF  to  resolve  the 
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dispute  with  DEC  to  lower  the  cost  of  repair  parts.  The 
USAF  will  cooperate  because  the  contract  binds  the  USAF  to 
resolve  disputes  like  this,  Some  parts  are  no  longer  made 
for  the  system.  It  will  be  the  CLS  contractor’s  problem  to 
seek  form,  fit,  and  functional  replacements  to  the  system  to 
keep  it  operational.  If  significant  problems  result  from 
the  unavailable  parts,  the  USAF  will  have  to  determine  re- 
placementor  substitution  policy  on  a  case  by  case  basis. 

Question  9.  The  Sentinel-Aspen  I  computer  contract 
puts  problems  with  configuration  changes  on  the  CLS  contrac¬ 
tors.  Configuration  changes  must  be  approved  by  USAF  confi¬ 
guration  control  boards  through  engineering  change  proposals 
(ECPs) .  The  system  must  stay  operational  during  configura¬ 
tion  changes.  No  configurations  were  made  to  the  system 
during  the  last  six  months  (since  its  operation  began) . 

Question  10.  The  Sentinel-Aspen  I  computer  system  has 
not  had  any  configuration  changes  since  the  beginning  (dur¬ 
ing  the  last  six  months) .  Future  work-arounds  by  the  CLS 
contractor  and  USAF  mangers  will  be  required  on  a  case-by¬ 
case  basis  if  the  system’s  configuration  changes. 

Question  11.  No.  The  Sent inel -Aspen  I  computer  sys¬ 
tem  has  not  had  any  major  PHS&T  or  facility  problems  since 
its  installation  began. 

Question  12.  The  USAF  should  have  bought  the  equipment 
drav/ings  and  other  suitable  data  for  the  modified  COTS 
equipment.  Program  funding  was  not  available  to  buy  this 
data  in  the  original  acquisition.  The  long  term  impact  on 
the  system  could  lead  to  early  obsolescence  or  difficulty 
when  recompeting  the  CLS  contract.  However,  even  if  suffi¬ 
cient  funding  had  been  available,  the  OEM  may  have  refused 
to  release  the  proprietary  information  on  the  modified  COTS 
equipment . 

Question  13.  Yes.  The  USAF  should  buy  more  computer 
equipment  like  the  Sent i ne 1 -Aspen  I.  COTS  are  suitable  for 
certain  applications  such  as  the  intelligence  equipment 
training  mission  of  the  Sentinel  systems.  COTS  should  only 
be  used  depending  upon  proposed  program’s  mission  and  ap¬ 
plication  (not  suitable  for  combat  type  applications). 

Question  14 .  Yes.  The  primary  advantage  of  using  COTS 
in  USAF  system  requirements  occur  when  the  USAF  can  incor¬ 
porate  available  technology  into  the  new  programs.  The  pri¬ 
mary  disadvantage  to  the  USAF  is  that  COTS  should  not  be 
used  for  combat  use. 
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Question  15.  No  and  yes.  The  Sent inel-Aspen  I  compu¬ 
ter  system  will  not  have  problems  with  manpower  cuts  because 
it  is  using  a  CLS  contract.  Limiting  budget  requirements 
for  the  Sentinel-Aspen  I  system  will  possibly  limit  upgrades 
and  parts  acquisitions  by  the  CLS  contractor  which  may  ulti¬ 
mately  affect  the  mission  effectiveness  of  the  intelligence 
training  system. 


21  Victor  Intelligence  Data  Handling  System,  Computer. 

Question  1.  The  21  Victor  system  is  also  known  as  the 
AN/GYQ-21 <V)  Intelligence  Data  Handling  System.  It  provides 
support  for  DoD  intelligence  services  and  agencies  at  130 
plus  locations  worldwide. 

Question  2.  No.  The  21  Victor  system  has  not  been  mo¬ 
dified  for  government  use. 

Question  3.  The  21  Victor  system  has  used  100%  CLS 
since  1976.  The  contract  requires  the  prime  contractor  (no 
subcontractors  are  involved)  to  maintain  the  system  at  a  95% 
effectiveness  level  per  month.  Vhen  system  problems  exceed 
the  contractor’s  capability,  the  contract  allows  for  outside 
technical  support  from  the  OEM.  Currently,  no  depot  support 
exists  for  the  21  Victor  system,  but  the  follow-on  CLS  con¬ 
tract  may  include  CLS  depot  support.  Past  CLS  contracts  on¬ 
ly  lasted  five  years,  but  the  next-  follow-on  CLS  contract 
will  last  ten  years. 

Question  4.  The  maintenance  support  system  has  im¬ 
proved  since  1976  because  the  CLS  contractor’s  personnel 
have  increased  their  experience  and  skill  level.  If  govern¬ 
ment  site  representatives  determine  that  engineering  person¬ 
nel  do  not  keep  the  equipment  at  the  95%  effectiveness  le¬ 
vel,  the  CLS  contractor  will  receive  maintenance  credits 
against  their  monthly  billing.  These  credits  are  monetary 
penalties  based  on  percentage  points  below  the  957»  effec¬ 
tiveness  level  stated  in  the  CLS  contract. 

Question  5.  Vhen  the  21  Victor  system  was  delivered, 
the  CLS  contractor  received  the  equipment/site  documents  to 
maintain  the  system.  Since  the  initial  delivery,  the  USAF 
has  taken  a  hands-off  approach  to  stay  appraised  with  the 
site  specific  drawings  for  the  21  Victor  system.  Vhen  pro¬ 
spective  contractors  have  wanted  more  information  about  the 
technical  data  in  order  to  bid  on  the  CLS  contract,  the  USAF 
has  given  prospective  CLS  contractors  ample  time  to  view  the 
site  drawings.  Then,  the  prospective  contractors  can  in¬ 
clude  any  update  costs  in  their  competitive  bids  for  the 
five  year  CLS  contract.  Since  the  USAF  does  not  plan  any 
system  modifications,  the  USAF  does  not  have  any  use  for 
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equipment/site  drawings.  However,  the  requires  the  CLS  con¬ 
tractor  to  provide  data  and  logs  for  site  specific  repair 
actions  (through  the  government  site  inspectors). 

Question  6.  Yes.  The  21  Victor  system  is  a  stand 
alone  system.  The  biggest  challenge  to  the  government  was 
to  install  the  COTS  equipment  into  SCI  facilities.  The 
original  system  was  installed  by  contract  and  government 
personnel.  The  system  has  been  integrated  with  government 
communications  networks  since  the  original  installation. 

The  system  is  not  strictly  the  USAF's  nor  DoD's.  The  lo¬ 
gistics  manager  was  not  working  this  system  originally,  but 
he  has  information  that  describes  a  smooth  installation. 

Question  7.  The  CLS  contract  for  the  21  Victor  system 
does  not  provide  for  initial  formal  training  for  CLS  person¬ 
nel.  If  the  USAF  enhances  the  system,  the  CLS  contractor 
will  be  asked  if  they  can  support  the  enhancements.  If  the 
contractor  agrees  to  the  changes,  the  USAF  will  pay  the  con¬ 
tract  personnel  to  attend  the  manufacturer’s  school.  The 
training  is  adequate. 

Question  8.  Yes.  The  USAF  does  not  dictate  to  the  CLS 
contractor  how  to  stock  spares  for  the  21  Victor  system. 

The  95%  effectiveness  level  requirement  has  caused  the  CLS 
contractor  to  stock  some  spares,  but  the  USAF  does  not  get 
involved  in  determining  the  stock  levels. 

Question  9.  Configuration  control  for  the  21  Victor 
system  is  the  CLS  contractor’s  problem.  The  USAF  only  pays 
for  the  upgrades/enhancements  to  the  equipment.  Ultimately, 
the  contractor  makes  the  choice  whether  they  will  install 
ihe  enhancements  or  upgrades  to  the  system. 

Question  10.  The  CLS  contractor  for  the  21  Victor 
system  is  required  to  pay  for  a  subscription  service  from 
the  OEM  for  equipment  upgrades/enhancements.  The  USAF  al¬ 
lows  the  CLS  contractor  to  choose  these  configuration  chan¬ 
ges  as  an  optional  requirement  of  the  contract. 

Question  11.  No.  The  21  Victor  system  does  not  have 
any  specific  or  general  PHS&T/f aci 1 i ty  problems. 

Question  12.  The  21  Victor  system  has  seen  the  pro¬ 
liferation  of  its  use  in  local  area  networks  (LANs)  and  wide 
area  networks  (VANs)  during  the  last  few  years.  Since  1984, 
the  USAF  has  used  an  on-site  maintenance  concept  to  support 
the  system,  but  proliferation  of  the  system  into  more  LANs 
and  VANs  has  created  some  peculiar  support  problems.  Some 
equipment  is  installed  at  remote  locations  as  part  of  the 
network  connections.  If  a  contract  person  abandons  the  main 
system  while  correcting  remote  problems,  he  may  not  be  able 
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to  keep  the  main  system  at  the  95%  effectiveness  rate  (such 
as  when  the  main  system  breaks  during  the  travel  to/from  the 
remote  location).  The  USAF  can  not  enforce  the  95%  effec¬ 
tiveness  rate  for  this  type  of  situation  when  there  is  only 
one  technician  at  the  main  site  and  many  multiple  sites. 

So,  the  USAF  is  considering  a  central  site/remote  location 
maintenance  concept  to  be  added  to  the  next  CLS  contract. 

The  provision  would  allow  more  funding  for  more  site  person¬ 
nel  when  additional  remote  equipment  is  added,  or  the  USAF 
would  use  a  suspension  rule  for  the  effectiveness  rate  while 
one  person  site  personnel  are  away  working  on  remote  equip¬ 
ment  . 


Question  13.  Yes.  The  USAF  should  buy  additional 
equipment  for  the  21  Victor  system.  The  Defense  Intelli¬ 
gence  Agency  (DIA)  recently  released  a  new  five  year  con¬ 
tract  to  buy  more  equipment.  The  government  is  getting 
smarter  by  taking  advantage  of  commercially  available  sys¬ 
tems  that  use  proven  technology.  The  government  does  not 
have  to  keep  up  with  the  drawings  or  engineering  designs. 
Since  the  technology  is  advancing  rapidly,  the  government  is 
better  off  buying  COTS  systems  because  the  "red-tape”  to 
acquire  developed  systems  takes  too  much  time.  Buying  COTS 
allows  the  government  to  enjoy  savings  of  many  economies  of 
scale . 


Question  14.  Yes.  The  primary  advantage  of  buying 
COTS  is  the  savings  to  the  government  because  they  do  not 
have  to  design  the  system  when  it  is  available  on  the  mar¬ 
ket.  It  is  not  an  intelligent  choice  to  design  when  the 
system  is  proven  on  the  open  market  place.  Another  advan¬ 
tage  of  buying  and  supporting  COTS  is  using  one  CLS  contract 
to  support  five  DoD  agencies.  By  having  a  single  chair  per¬ 
son  to  resolve  support  problems,  the  government  enjoys  the 
added  benefits  of  reduced  administrative  (logistics  manage¬ 
ment  support)  costs. 

Question  15.  Yes  and  not  sure.  Converting  the  pro¬ 
gram  to  organic  support  would  be  disastrous  because  the  go¬ 
vernment  could  not  replicate  the  experience  level  or  the 
system  knowledge  of  the  CLS  personnel  (especially  with  sys¬ 
tem’s  age  taken  in  consideration).  The  USAF  is  just  begin¬ 
ning  to  feel  the  effects  of  budget  cuts  for  the  21  Victor 
system.  It  is  too  early  to  tell  if  these  cuts  will  be  ad¬ 
verse  to  the  mission  of  the  21  Victor  system.  Some  cut¬ 
backs  in  other  programs  (such  as  the  decommissioning  of  the' 
SK-71  aircraft)  have  reduced  the  impact  of  budget  cuts. 
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Conclusion 


The  material  just  presented  the  results  from  the  tele¬ 
phone  interviews  with  the  managers  who  support  17  USAF  COTS 
systems.  Next,  Section  V  will  analyze  these  results. 


V .  Analysis 


Introduction 

This  section  presents  the  analyses  of  the  telephone  in¬ 
terview  results  found  in  Section  IV.  First,  the  interview 
response  data  will  be  presented  for  each  question.  Second, 
analysis  of  the  responses  to  the  15  questions  will  be  com¬ 
pared  and  contrasted  to  show  the  trends  of  logistics  support 
for  the  COTS  items  in  this  thesis.  Again,  the  reader  is  re¬ 
minded  the  results  of  this  study  may  not  be  applied  to  every 
type  of  COTS  systems  (as  discussed  in  Section  III).  Third, 
this  section  will  end  with  a  conclusion. 

Interview  Response  Data 

Of  the  18  logistics  managers  contacted,  17  participated 
in  this  research  study  to  make  the  response  rate  947..  Using 
Emory’s  suggestion  of  one  contact  call  plus  three  follow-up 
calls,  this  research  thesis  exceeded  the  85%  target  for  per¬ 
sonal  interviews  by  nine  percent  (Emory: 165) .  Originally, 
all  18  managers  agreed  to  participate  during  the  first  tele¬ 
phone  contact  call,  but  one  manager  could  not  participate 
because  he  was  assigned  to  temporary  duty  during  the  re¬ 
search  effort.  At  least  three  telephone  contacts  were  made 
with  each  manager  to  establish  the  date  and  time  of  the 
interview. 

All  managers  received  an  advanced  copy  of  the  question¬ 
naire  found  in  Appendix  A.  The  advanced  copies  were 
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distributed  as  follows:  14  were  mailed,  one  was  personally 
delivered  to  a  manager  who  attended  a  course  at  the  Air 
Force  Institute  of  Technology  (School  of  Systems  and  Logis¬ 
tics),  and  three  were  sent  by  fax  machine. 

The  managers  were  told  in  contact  calls  and  in  the  in¬ 
troduction  to  the  interview  that  the  interview  would  take 
approximately  30  minutes  of  their  time.  All  managers  were 
given  ample  time  to  answer  each  question.  Three  interviews 
lasted  30  minutes  or  less,  one  interview  went  past  40  min¬ 
utes,  and  the  remaining  13  interviews  lasted  between  30  and 
40  minutes.  The  interviewer  needed  to  probe  managers  about 
some  questions  to  prevent  non-responses.  Non-responses  to 
the  questions  resulted  from  either  the  managers'  lack  of 
knowledge,  or  the  system  did  not  have  the  features  or  enough 
operating  time  to  develop  usable  information.  Only  two 
managers  indicated  they  had  too  little  experience  to  answer 
all  of  the  questions. 

Sixteen  of  the  17  managers  wanted  to  read  the  follow-up 
results  of  this  research  study.  See  Section  VI  for  comments 
about  further  research  and  recommendations  regarding  the 
mangers’  interest  in  logistics  management  for  COTS  systems. 

Analysis  of  Question  Responses 

Analysis  of  the  responses  from  Section  IV  will  be  dis¬ 
cussed  below.  The  question  design  was  discussed  in  Section 
III.  Comparison  and  contrast  for  each  question  will  be  used 


5.2 


The 


support,  who  uses  it,  and  name  the  bases  that  use  it. 
Seventeen  COTS  programs  were  studied  in  this  thesis, 
equipment  descriptions  follow: 

1.  Three  programs  were  electronic  stand  alone  systems 
(two  were  fixed  plant  and  one  mobile/portable). 

2.  Three  programs  were  test,  diagnostic,  and  measure¬ 
ment  equipment  (all  were  portable). 

3.  Five  programs  were  stand  alone  computer  systems 
(all  were  fixed  plant). 

4.  One  program  was  power  conditioning  equipment  (fixed 
plant)  in  support  of  computer  systems. 

5.  Two  programs  were  mobile  construction  equipment. 

6.  One  program  was  a  general  purpose  vehicle. 

7.  Two  programs  were  aircraft. 

Hence,  12  of  the  15  COTS  programs  were  related  to  electronic 
systems.  Three  of  the  remaining  five  programs  were  related 
to  land  or  air  transportation  equipment.  The  final  two  pro¬ 
grams  were  vehicular  construction  equipment. 

All  17  programs  supported  the  USAF.  Each  programs’ 
support  level  will  be  discussed  below: 

1.  One  program  supported  worldwide  missions  from  the 
CINCs  down  to  base  level  for  the  NMCC,  alternate  NMCC, 
DoD,  and  USAF. 

2.  One  program  supported  worldwide  missions  at  the 
CINCs’  level  for  the  DoD  and  USAF. 

3.  One  program  supported  worldwide  missions  from  the 
CINCs  down  to  base  level  for  the  DoD  and  USAF. 
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4.  One  program  supported  missions  between  a  CONUS  base 
and  an  European  Command  base  at  the  CINCs’  level  for 
the  DoD  and  USAF. 

5.  Two  programs  supported  missions  at  two  or  less 
CONUS  locations  for  the  DoD  and  USAF  CINCs. 

6.  Three  programs  supported  worldwide  missions  at  the 
base  level  for  the  DoD  and  USAF. 

7.  One  program  supported  missions  at  one  CONUS 
location  for  the  DoD  and  USAF. 

8.  Seven  programs  supported  worldwide  missions  at  the 
base  level  for  the  USAF. 


In  summary,  one  program  supported  missions  higher  than 
the  DoD,  nine  programs  supported  missions  for  the  DoD  and 
USAF,  and  seven  programs  supported  missions  only  for  the 
USAF.  Thirteen  of  the  17  programs  supported  worldwide  mis¬ 
sions,  and  four  supported  CONUS  missions. 


Question  2:  Has  this  COTS  system  been  modified  for 


overnment  use.  or  is  the  system  pure  COTS  purchased  from 


the  vendor  as-is  lust  like  the  civilian  sector?  If  you  an¬ 


swered  yes,  how  is  the  system  modified?  Only  eight  of  the 
17  programs  qualified  as  pure  COTS.  However,  four  of  these 
eight  required  some  work  by  the  USAF  to  acquire  operational 
systems  as  follows: 


1.  One  system  did  not  exist  on  the  open  market,  but 
the  U  SAF’ s  request  for  proposal  <RFP>  generated  a  com¬ 
mercial  version  that  I  t  the  USAF’s  mission  require¬ 
ments. 


2.  One  system  was  a  ruggedizei  product  built  to  with- 
stand  government  standards  and  only  sold  to  the  USAF. 

3.  One  system  required  the  contractor  to  build  a 
special  console  to  meet  USAF  standards,  but  the  form, 
fit,  and  function  (F3 >  of  the  system  remained  original 
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4.  One  system  required  customized  software  development 
by  USAF  personnel  to  make  the  hardware  fit  the  USAF’s 
mission  requirements. 

The  remaining  nine  COTS  systems  were  modified  for  vari¬ 
ous  reasons  described  below: 

1.  Two  aircraft  systems  required  modified  paint 
schemes  and  communications  equipment  <GFE>  to  be  added 
to  meet  USAF  standards. 

a.  One  plane  program  required  the  CLS  contractor 
to  modify  the  recommended  OEM’ s  maintenance  stan¬ 
dards  to  meet  USAF  standards) . 

2.  Three  electronic  COTS  systems  required  some  modifi¬ 
cations  to  interface  DoD^USAF  COMSEC  equipment  and  to 
meet  TEMPEST  standards. 

3.  Two  other  electronic  COTS  systems  required  slide-in 
circuit  card  modifications  to  meet  higher  DoD/USAF 
technical  standards  than  the  standards  used  in  the  com¬ 
mercial  market  place, 

4.  Two  vehicular  systems  required  USAF  paint  schemes. 

a.  One  required  height  reductions  to  fit  inside 
USAF  transport  aircraft. 

In  summary,  four  of  the  17  COTS  programs  were  bought 
strictly  off  the  shelf.  The  remaining  13  programs  were  mod¬ 
ified  (either  by  the  USAF  or  the  contractor/vendor )  to  meet 
security,  facility,  or  technical  government  standards. 

Question  3:  How  is  the  COTS  system  supported:  CLS  (or- 


anizational,  intermediate,  or  depot),  or  orsranic  (organiza¬ 


tional,  intermediate,  or  depot)? 


lanned 


If  the  COTS  system  is  su 
for  the  life  of  the  sys- 


tem,  or  is  the  CLS  subject  to  competitive  negotiation  at 


specific  intervals?  Is  there  more  than  one  CLS  contractor 


for  the  system?  If  so,  are  there  any  discrepancies  as  to 
which  contractor  rnaintains/repairs  the  item(s)? 


One  of  the  17  programs  gave  the  user  the  option  to 
choose  between  total  CLS  at  the  organizational  level  with 
full  CLS  factory/depot  support  from  the  OEM,  or  the  user 
could  use  organic  support  at  the  organizational  level  along 
with  the  CLS  depot  support.  The  remaining  16  programs  fit 
neatly  into  the  five  types  of  logistics  support  listed 
below: 

1.  Eight  programs  (including  the  first  program  men¬ 
tioned  above)  used  organizational  organic  logistics 
support  with  f actory/depot  CLS. 

2.  Four  programs  (including  the  first  program  men¬ 
tioned  above)  used  CLS  for  both  organizational  and 
depot  levels. 

3.  Three  programs  used  100%  organic  logistics  support 
without  depot  support. 

4.  Two  programs  used  100%  CLS  at  the  organizational 
level  without  depot  support. 

5.  One  program  used  organic  logistics  support  for  both 
organizational  and  depot  levels. 

Thirteen  of  the  17  programs  used  some  type  of  CLS  con¬ 
tract.  The  length  of  the  CLS  contracts  are  described  below: 

1.  Two  organizational  and  depot  CLS  contracts  lasted 
for  the  life  of  the  systems. 

a.  One  contract  will  convert  to  organic  organiza¬ 
tional  logistics  support  with  CLS  depot  support  as 
soon  as  possible. 

2.  One  organizational  and  depot  C.LS  contract  was  pre¬ 
priced  for  20  years. 

3.  One  organizational  and  depot  CLS  contract  lasted 
one  year  with  a  four  year  option  and  was  being  sched¬ 
uled  for  a  five  year  follow-on  CLS  contract. 
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4.  Two  organizational  CLS  contracts  (without  depot 
level  support)  lasted  for  five  years  (one  will  use  a 
follow-on  ten  year  CLS  contract  with  its  prime  contrac¬ 
tor  )  . 

5.  The  remaining  seven  programs  used  CLS  depot  con¬ 
tracts  with  organizational  organic  logistics  support 
for  the  life  of  the  systems. 

In  summary,  only  two  of  the  13  CLS  contracts  had  more 
than  one  CLS  contractor  per  program.  One  program  used  sep¬ 
arate  hardware  and  software  vendors.  The  USAF  required  the 
contractors  to  resolve  their  problems/disagreements  through 
government  site  representatives.  The  other  program  used  a 
single  prime  contractor  for  CLS,  but  the  prime  contractor 
used  subcontractors  to  perform  the  maintenance  on  the  system 
at  multiple  locations.  No  problems  have  been  encountered  to 
date  because  the  contract  imposes  monetary?  penalties  on  the 
prime  contractor  if  they  do  not  meet  USAF  mission  capable 
rates. 

Question  4:  How  did  the  maintenance  support  concept 

degrade  or  improve  for  the  CQTS  system?  What  steps  were  re¬ 
quired  to  resolve  any  problems?  Only  one  program  had  de¬ 
graded  contract  maintenance,  and  the  USAF  was  pursuing  or¬ 
ganic  maintenance  and  training  to  cut  costs  and  improve 
customer  satisfaction.  Maintenance  support  for  the  remain¬ 
ing  16  programs  are  desribed  below: 

1.  Six  systems  were  too  new  to  assess  the  maintenance 
support  concept. 

a.  One  of  these  programs  was  expected  to  improve 
because  monthly  cost  accounting  procedures  were 
being  instituted,  and  a  provision  was  being  added 
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to  the  contract  to  permit  the  contractor  to  update 
any  part  of  the  system  when  required. 

2.  Two  programs  will  improve  their  maintenance  support 
concept  because  the  new  equipment  is  replacing  older/ 
obsolete  equipment. 

3.  Eight  programs  significantly  improved  their  mainte¬ 
nance  concept  for  two  reasons. 

a.  The  most  frequent  reason  for  improvement  re¬ 
sulted  from  contract  language  that  required  the 
contractor/vendor  to  maintain  the  equipment  at 
high  levels  of  effectiveness  (such  as  35%  or  95%). 

b.  The  second  reason  maintenance  support  improved 
for  a  COTS  program  occurred  because  the  COTS  sys¬ 
tem  usually  replaced  many  older/obsolete  systems 
that  had  become  insupportable. 

In  summary,  too  many  systems  were  too  new  to  allow  the 

researcher  to  make  conclusions  about  whether  the  maintenance 


1.  All  17  programs  used  commercial  technical  manuals. 
Fifteen  of  the  systems’  commercial  manuals  were  consi¬ 
dered  adequate. 
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2.  Two  COTS  systems  were  undergoing  the  formal 

USAF  review  process  for  their  commercial  manuals. 

Updates  for  commercial  manuals  were  either  sent  direct¬ 
ly  to  the  user/CLS  contractor  from  the  factory/vendor,  or 
the  updates  were  shipped  to  the  ALC  that  supported  the  COTS 
program.  When  updates  to  commercial  manual  are  sent  to  the 
ALCs,  the  changes  are  reviewed,  copied,  stocked,  and  mailed 
to  users/CLS  contractors. 

Drawings  and  engineering  data  rights  are  discussed  be¬ 
low: 


1.  Three  programs  had  some  engineering  data  for  their 
equipment.  The  engineering  data  was  site  specific  in¬ 
stallation  drawings  that  showed  interfacing  between  GFE 
and  COTS  equipment. 

2.  Three  programs  (all  were  electronic  test  equipment) 
had  no  comments  about  the  data  rights  to  engineering 
drawings  (but  from  the  researcher’s  experience  with 
electronic  test  equipment,  engineering  data  for  most 
test  equipment  is  proprietary  information). 

Other  forms  of  control  used  by  the  USAF  to  maintain 

system  integrity  are: 

1.  One  contract  required  the  vendor  to  notify  the  USAF 
within  180  days  for  reprocurement  data  (such  as  an  off¬ 
er  to  buy  proprietary  drawings  if  the  vendor  would  go 
out  of  business). 

2.  One  contract  required  the  vendor  to  notify  the  USAF 
within  60  days  of  class  I  engineering  change  proposals 
to  the  system  (this  gave  the  USAF  the  ability  to  stop 
automatic  configuration  changes  that  did  not  have  USAF 
consent ) . 

3.  Other  contracts  put  the  burden  of  maintaining  cur¬ 
rent  technical  data  entirely  on  the  CLS  contractor. 

4.  Several  contracts  require  either  software  or  CLS 
'hardware)  contractors  to  subscribe  or  buy  into  an 
updating  service  from  the  OEM. 
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Question  6:  Was  it  necessary  to  integrate  the  LETS 

system  into  any  other  pre-existing  systems  or  facilities? 


Who 

performed  the  integration 

(prime  contractor,  CLS  con- 

trac 

tor , 

or  the 

government >  ? 

Is  the  configuration  unique  to 

the 

Air 

Force? 

What  problems 

were  encountered  during  and 

after  the  integration,  and  how  were  they  resolved?  Only 
five  of  the  17  progi  aras  were  not  integrated  into  other  pre¬ 
existing  systems  or  facilities.  The  integration  efforts  for 
the  remaining  12  programs  are  described  below: 

1.  Four  programs  used  the  prime  contractor  (one  used  a 
subcontractor )  to  perform  the  integration  effort. 

2.  Eight  programs  were  integrated  by  the  USAF/govern- 
raent  personnel  (two  with  contractor  help  and  one  with 
the  CLS  contractor’s  help). 

Only  five  of  the  COTS  programs  were  unique  to  the  USAF. 
Three  of  those  five  were  unique  systems  using  common  off  the 
shelf  equipment.  The  three  systems  were  uniquely  configured 
to  meet  USAF  requirements  that  were  not  used  commercially. 
The  other  two  programs,  unique  to  the  USAF,  had  commercial 
derivatives,  but  the  models  used  by  the  USAF  had  not  been 
sold  in  the  commercial  market. 

Eight  of  the  17  programs  encountered  significant  inte¬ 
gration  problems  described  below: 

1.  Four  programs  required  interfacing  with  COMSEC  GFE 
and  government  facilities. 

2.  One  program  was  delayed  because  the  subcontractor 
did  not  meet  the  government’s  TEMPEST  installation 
standards  (the  installation  had  to  be  reworked). 

3.  Two  programs  required  special  support  equipment  to 
maintain  their  systems  at  USAF  bases: 
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a.  One  required  a  special  test  stand. 

b.  The  other  required  additional  power  carts  on 
the  flightline. 

4.  One  program  required  special  plug-in  circuit  cards 
to  allow  the  system  to  meet  DoD/USAF  standards. 

Question  7.  Vhat  type  of  training  format  is  required? 

Vho  provides  it?  Who  receives  it?  Is  it  necessary?  Is  it 

adequate?  Are  there  any  problems  with  the  training? 

Training  for  the  17  programs  is  listed  below: 

1.  Seven  programs  used  only  on  the  job  training  (OJT) 
for  government  operations  and  maintenance  (O&M)  per¬ 
sonnel  (except  one  that  gave  the  system  engineer  and 
equipment  specialist  factory  training). 

2.  Two  programs  did  not  require  any  training  format 
because  the  CLS  contractor  was  required  to  use  quali¬ 
fied  personnel  to  support  these  systems.  However,  the 
USAF  will  pay  the  CLS  contractors  to  send  CLS  personnel 
to  factory  training  if  enhancements  are  added  to  the 
system. 

3.  Five  programs  used  a  variety  of  training  methods  at 
various  stages  of  the  programs’  development.  Each  of 
the  five  programs  used  different  combinations  of  fac¬ 
tory  and  USAF  government  training  formats  for  USAF/DoD 
and  CLS  personnel.  However,  all  five  programs  used 
vendor  provided  factory  training  when  the  program  was 
initiated . 

a.  Two  programs  will  be  converting  the  O&M  train¬ 
ing  to  an  organic  USAF  capability. 

b.  Three  programs  will  rely  on  vendor/CLS  train¬ 
ing  because  mockups  for  classroom  training  were 
not  funded  in  the  initial  contracts. 

4.  Three  programs  used  vendor  or  contract  training 
formats  for  government  O&M  personnel. 

a.  One  used  OJT  for  the  interim  contract  to 
bridge  training  until  the  formal  factory  training 
was  in  place. 

b.  One  program  was  too  new  to  assess  the  effec¬ 
tiveness  of  the  training.  This  newness  trend 
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affected  two  of  the  seven  programs  mentioned  above 
that  were  using  formal  training  formats. 

c.  One  program  had  no  significant  problems  with 
this  training. 

In  summary,  seven  programs  used  OJT  training,  and  ten 
programs  used  formal  training  formats.  Seven  of  the  ten 
programs  that  used  formal  training  were  adequate,  and  the 
remaining  three  programs  were  too  new  to  evaluate  the  ade¬ 
quacy  of  the  training.  Five  of  the  seven  programs  (that  had 
adequate  formal  training)  used  a  variety  of  training  formats 
during  the  programs’  development  to  give  the  USAF  greatest 
flexibility  to  keep  qualified  CLS  and  USAF  O&M  personnel 
aval lable . 

Question  8:  Are  critical  failure  parts  easily  accessi¬ 

ble  for  the  COTS  system?  Who  provides  the' spare  parts?  Are 
there  any  delays  or  problems  in  getting  the  parts  needed  to 
keep  the  system  operational?  What  steps  were  required  to 
resolve  any  problems?  The  critical  spares  supplier  for  the 
17  programs  are  described  below: 

1.  Eleven  programs  obtained  critical  spares  from  the 
vendor  or  CLS  contractor, 

a.  One  of  the  eleven  programs  also  had  some  pro¬ 
visioning  for  organic  support  (from  overseas  re¬ 
mote  locations  or  an  option  that  was  chosen  by  the 
user)  included  with  the  vendor ''contractor  supplied 
parts. 

2.  Six  COTs  programs  used  government  provisioned 
parts  supply  functions. 

a.  Two  of  the  government  provisioned  programs 
used  contractor  operated  parts  stores. 
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b.  One  of  the  government  provisioned  programs 
allowed  either  organic  or  contract  maintenance 
personnel  to  have  access  to  the  spares. 

c.  The  other  three  government  provisioned  pro¬ 
grams  stocked  spares  for  users  to  meet  expected 
failure  rates. 

The  delays  or  problems  for  the  17  programs  are  dis¬ 
cussed  below: 

1.  Twelve  programs  did  not  have  any  delays  or  problems 
with  critical  spares. 

2.  Two  programs  were  too  new  when  fielded  and  experi¬ 
enced  routing  delays  (one  required  the  USAF  to  speed  up 
the  provisioning  process  to  prevent  impacts  on  the 
users’  mission). 

3.  One  program  also  experienced  routing  delays  because 
equipment  was  too  mobile  and  difficult  to  track  in 
overseas  locations.  The  MAJCOM  worked  with  the  ALC  to 
create  a  liaison  office  and  install  a  computer  track¬ 
ing  system  to  reduce  the  routing  delays  for  critical 
spares  and  time  compliance  technical  orders  (TCTOs) . 

4.  One  program  also  experienced  routing  delays,  but  no 
recommendations  were  mentioned  to  correct  this  problem. 

5.  One  program  experienced  problems  with  maintaining 
the  original  form,  fit,  and  function  <F3)  of  the  sys¬ 
tem.  Some  parts  for  this  system  were  no  longer  manu¬ 
factured  or  available  to  the  CLS  contractor.  The  CLS 
contractor  had  to  submit  F3  changes  to  the  USAF  for  re¬ 
view  and  approval  before  substituting  critical  failure 
parts. 

In  summary,  all  17  programs  had  easy  access  to  critical 
spares.  Twelve  of  the  17  programs’  spares  were  supplied  by 
the  vendor/CLS  contractor,  and  five  programs’  spares  were 
supplied  by  the  USAF.  Only  five  programs  experienced  any 
major  delays  or  problems  with  these  critical  spares. 

Question  9:  Describe  how  the  conf isuration  management ^ 

control  is  impacted  by  spare  parts  for  the  COTS  system. 
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What  impact  is  created  when  the  configuration  of  the  COTS 


system  changes?  Does  the  system  remain  operational  after 
the  configuration  changes?  Vhat  steps  were  required  to 
resolve  any  problems?  All  17  COTS  systems  will  remain  oper¬ 
ational  if  configuration  changes  occur.  If  conf iguration 
changes  occur,  minimal  or  no  impact  on  spares  will  occur  for 
14  of  the  17  COTS  systems.  Seven  of  the  14  programs  con¬ 
trolled  configuration  changes  by  using  contract  requirements 
(usually  requiring  the  contractor/vendor  to  submit  engineer¬ 
ing  change  proposals  to  USAF  configuration  control  boards 
for  approval).  The  other  seven  of  14  programs  are  described 
be  1  o  w: 


1.  Two  programs,  that  have  had  little  or  no  impact  on 
their  spares,  had  no  comments  about  resolving  past  con¬ 
figuration  problems. 

2.  Two  programs,  that  have  had  little  or  no  impact  on 
their  spares,  had  core  designs  that  remained  static 
after  the  vendor  made  configuration  changes. 

3.  Three  programs  with  little  impact  on  their  spares 
dealt  with  configuration  changes  as  follows: 

a.  The  USAF  obtained  supplemental  data  for  the 
affected  spares. 

b.  The  USAF  depended  on  the  market  for  spares  and 
will  salvage/replace  the  system  after  ten  years  of 
use . 


c.  The  USAF  will  obtain  substitute  common  equip¬ 
ment  if  the  configuration  changes  affect  i.he  oper¬ 
ation  of  the  older  equipment  (no  spare  parts  are 
stocked  by  the  USAF). 

The  remaining  three  of  the  17  COTS  programs  controlled 
configuration  changes  by  using  contract  requirements  (these 
contracts  usually  required  the  contract or /vendor  to  submit 
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engineering  change  proposals  to  USAF  configuration  control 
boards  for  approval).  The  three  programs  are  described 
below: 

1.  One  program  was  too  new  to  assess  the  impact  of 
configuration  changes  on  the  spares,  but  the  CLS  con¬ 
tractor  was  fully  responsible  for  maintaining  the  crit¬ 
ical  spares  at  his  expense. 

2.  One  program  would  adjust  USAF  spares  according  to 
the  degree  of  the  configuration  change. 

3.  One  program  required  the  CLS  contractor  to  assume 
all  responsibility  for  upgrades  and  site  configuration 
control,  but  potential  production  spares  could  become 
nonfunctional  if  the  configuration  changes  are  extreme. 

In  summary,  ten  of  the  17  programs  include  contract 
language  that  gave  the  USAF  configuration  control  (through 
configuration  control  boards,  CCBs)  for  these  systems.  Only 
two  managers  had  no  comments  concerning  procedures  for  deal¬ 
ing  with  configuration  change  problems  in  their  programs. 

The  USAF  will  replace  the  COTS  system  every  ten  years  for 
one  program  to  deal  with  configuration  changes. 

Question  10:  Describe  how  your  staff  has  adapted  to 
any  conf iyurat ion  changes  with  the  COTS  system.  Vhat  steps 
were  required  to  resolve  any  problems?  Eleven  of  the  17 
programs  used  contracts  to  adapt  to  configuration  changes. 
The  contracts  for  these  eleven  programs  will  give  the  USAF 
the  ability  to  reject  configuration  changes  ^except  when  re¬ 
lated  to  safety  modifications).  Adaptations  to  configura¬ 
tion  changes  for  the  other  six  programs  are  described  below: 

1.  Two  programs  are  not  expected  to  have  any  config¬ 
uration  changes.  So,  this  question  did  not  apply. 
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2.  The  USAF  adapted  two  programs  by  matching  common 
parts  between  yearly  models. 

a.  One  program  will  replace  its  systems  when  they 
are  ten  years  old  (because  spares  and  support 
costs  increase  significantly  after  ten  years). 

b.  One  program  will  buy  small  quantities  every 
year.  So,  the  ALC  must  cross  reference  spare 
parts  between  yearly  models  to  simplify  repairs  on 
older  models. 

3.  Two  programs  adapt  to  configurations  changes  as 
foil ows : 

a.  The  USAF  will  test  all  changes  before  buying 
and  installing  the  changes  into  every  system. 

b.  The  USAF  will  allow  the  two  vendors  to  add  new 
models  as  line  items  to  the  acquisition  contract 
(this  allows  the  users  to  replace  older  models 
that  become  insupportable  to  age  or  extreme  con¬ 
figuration  changes. 

Question  11:  Does  your  COTS  system  have  any  support 

problems  due  to  improper  packaging,  handling,  storage,  and 
transportation?  Facilities?  Other?  Ten  of  the  17  pro¬ 
grams  did  not  have  any  problems  with  PHS&T  or  with  facili¬ 
ties  (one  of  the  programs  was  too  new  to  assess  this  ques¬ 
tion).  The  remaining  seven  programs  are  described  below: 

1.  Three  programs  only  had  facility  problems  tc  sup¬ 
port  these  COTS  systems,  These  programs  required  spe¬ 
cial  TEMPEST  approved  facilities  to  be  built  to  house 
the  systems.  The  contractor  was  responsible  for  all 
damages  to  these  three  systems  that  was  caused  by 
PHS&T . 

2.  Four  programs  had  multiple  PHS&T,  facility,  and 
other  support  problems  as  fellows: 

a.  One  program  had  a  storage  problem  which  ac¬ 
celerated  wear  to  the  systems’  painted  surfaces. 
The  system  also  bad  a  problem  with  giving  all  of 
the  systems’  operators  experience  because  the  sys¬ 
tems  required  only  the  best  operators  (primarily 
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because  this  system  supported  DoD  and  USAF  execu¬ 
tives)  . 

b.  One  program  required  drop-bed  trailers  to 
transport  the  system  between  operating  locations, 
and  it  required  special  heaters  or  heated  facili¬ 
ties  to  store  the  system  during  the  winter  sea¬ 
son  . 

c.  One  program  frequently  experienced  transpor¬ 
tation  damage  that  USAF  personnel  fail  to  detect 
during  the  initial  inspection.  The  program  also 
required  systems  going  overseas  by  sealift  to  re¬ 
ceive  anti-corrosion  treatments. 

d.  One  program  experienced  occasional  packaging 
failures  during  transportation  from  the  factory. 
The  USAF  required  the  contractor  to  pay  all  dama¬ 
ges.  The  program  also  experienced  transportation 
delays  from  redirect  orders  (RDOs)  by  the  shipping 
company.  The  USAF  resolved  this  problem  through 
the  USAF’s  transportation  office  at  the  ALC . 

Question  12:  If  you  could  change  anything  about  the 

system,  what  would  you  like  to  do  to  improve  the  logistics 

support  for  the  CQTS  system?  Five  of  the  17  managers  did 

not  make  any  recommended  improvements  for  their  programs. 

Recommendations  for  the  remaining  12  managers  are  below: 

1.  Two  managers  would  have  fully  provisioned  their 
COTS  systems  (one  would  have  used  installation  cri¬ 
terion  for  high  altitude  electromagnetic  pulse  (HEMP) 
protection,  purchased  level  III  engineering  drawings, 
and  outlawed  spares  kits). 

2.  Two  managers  also  made  recommendations  to  improve 
the  provisioning  process  for  their  programs. 

a.  One  manager  recommended  complete  provisioning 
before  fielding  the  equipment  (which  included 
depot  provisioning  when  using  organizational 
organic  logistics  support). 

b.  One  manager  recommended  freezing  the  spares 
baseline  during  the  provisioning  process  to  allow 
the  USAF  to  maintain  configuration  control  over 
the  COTS  system. 
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3.  Two  managers  recommended  that  once  the  USAF  com¬ 
mitted  the  program  to  COTS,  no  modifications  should  be 
allowed  to  meet  special  requirements. 

a.  One  manager  was  emphatic  that  once  CLS  was 
chosen,  the  USAF  should  not  change  to  organic  lo¬ 
gistics  support  or  buy  proprietary  data,  technical 
manuals,  or  spares. 

b.  The  other  manager  wanted  a  streamlined  acqui¬ 
sition  process  for  buying  pure  COTS. 

4.  One  manager  also  wanted  a  way  to  speed  the  acqxiisi- 
t ion/provisioning  process.  However,  this  manager  would 
have  used  a  prime  contractor  for  large  integrated  sys¬ 
tems. 

5.  Two  managers  recommended  buying  larger  quantities 
of  COTS  systems  for  their  programs. 

a.  One  manager  felt,  the  USAF  could  not  get  econo¬ 
mies  of  scale  from  smaller  buys. 

b.  One  manager  wanted  the  USAF  to  buy  ahead  to 
fill  customer  demands  rather  than  forcing  the  cus¬ 
tomer  to  wait  two  years  to  get  authorization  and 
budgeting  procedures  accomplished. 

6.  Two  managers  made  recommendations  about  the  draw¬ 
ings  and  technical  data  for  their  programs. 

a.  One  manager  advised  buying  technical  manuals 
as  early  as  possible  when  integrating  large  COTS 
systems  into  MIL-SPEC  equipment. 

b.  One  manager  recommended  including  the  funding 
to  buy  type  III  engineering  drawings  (if  the  OEM 
will  sell  them)  when  the  USAF  buys  modified  COTS. 

7.  One  manager  recommended  updating  the  CLS  contract 
when  the  COTS  system  is  expanded  beyond  the  original 
installation  site.  The  update  to  the  CLS  contract 
would  add  CLS  personnel  or  relax  the  effectiveness  rate 
if  the  main  system  broke  while  a  CLS  service  person  was 
working  at  a  remote  site. 

In  summary,  five  managers  made  no  recommendations. 

Three  managers  recommended  improving  the  acquisition/pro¬ 
visioning  process  for  their  COTS  programs.  Two  managers 
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recommend  fully  provisioning  their  COTS  programs.  Two  man¬ 
agers  recommended  keeping  pure  COTS  with  CLS.  Two  managers 
recommended  buying  larger  quantities  of  COTS  systems  for 
their  programs,  Two  managers  made  recommendations  about  the 
drawings  and  technical  data  for  their  programs.  One  manager 
recommended  updating  the  CLS  contract  when  the  COTS  system 
is  expanded  beyond  the  original  installation  site. 

Question  13:  Vould  you  recommend  buying  more  of  these 

COTS  systems  if  you  knew  what  you  know  now,  and  why  or  why 
not?  Vould  you  recommend  COTS  for  other  systems?  Vhat  type 
and  why?  Only  one  manager  had  unfavorable  recommendations 
for  buying  additional  COTS  units  in  his  program.  The  mana¬ 
ger  said  the  USAF  should  have  waited  to  buy  the  next  gene¬ 
ration  COTS  model  from  the  vendor  becau'se  the  newer  model 
had  more  enhancements  than  the  original  model.  One  of  the 
remaining  16  managers  was  not  sure  if  the  USAF  should  buy 
additional  units  for  his  program  because  the  USAF  always  had 
a  budget  shortfall  that  prevented  buying  in  sufficient  quan¬ 
tities  to  allow  savings  from  economies  of  scale. 

The  remaining  14  managers  recommended  buying  additional 
units  for  their  COTS  programs.  Seven  of  these  managers  did 
not  explain  why  they  would  buy  additional  units.  However, 
the  following  seven  managers  explained  their  reasoning  as 
f ol lows: 

1.  Keep  the  I LS  representative  active  throughout 

the  acquisition  process. 
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2.  Only  buy  additional  units  depending  on  the  level  of 
modifications  made  to  the  COTS  system. 

3.  The  Air  Force  should  include  Japanese  models  in  the 
product  mix  because  of  their  high  reliability. 

4.  Yes,  COTS  was  interfaced  with  GFE  which  sped  the 
acquisition  process;  where  pure  COTS  would  have  slowed 
the  acquisition  process, 

5.  The  advantages  of  using  COTS  outweigh  its  disadvan¬ 
tages. 

6.  Yes,  only  if  the  USAF  develops  a  uniform  support 
structure  for  COTS. 

7.  Yes,  COTS  systems  were  extremely  reliable  and 
filled  a  critical  gap  for  the  USAF. 

Four  of  the  17  managers  made  no  comments  about  buying 
other  types  of  COTS  for  USAF  missions.  One  manager  did  not 
recommend  buying  more  COTS  until  the  USAF’s  acquisition  pro¬ 
cess  is  streamlined  to  buy  COTS  products.  However,  the 
other  12  managers  made  additional  recommendations  for  other 
COTS  systems  that  could  be  bought: 

1.  The  government  should  have  bought  more  COTS  long 
ago,  especially  systems  with  replaceable  circuit  cards. 

2.  More  COTS  should  be  purchased  with  CLS.  Tradeoff 
decisions  have  to  be  made  depending  on  the  support  re¬ 
quirements,  amount  of  funding  available,  and  manpower. 
The  USAF  should  study  the  COTS  program  to  see  if  it  can 
satisfy  its  war  essential  mission  before  buying. 

3.  Use  COTS  systems  where  possible  except  applications 
such  as  combat  missions. 

4.  COTS  systems  must  be  evaluated  case-by-case  depend¬ 
ing  on  the  needs  and  requirements  of  the  program. 

5.  More  COTS  should  be  purchased  only  after  minimum 
data  requirements  are  met. 

6.  Buying  more  COTS  systems  is  good,  but  the  system 
must  be  evaluated  to  stay  in  budget  when  replacing 
older  systems. 
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7.  Systems  like  computers  can  be  applied  any  mission 
with  creative  approaches. 

8.  COTS  advantages  negate  the  impacts  of  constant,  con¬ 
figuration  changes.  Ruggedizaton  for  COTS  remains  a 
major  concern. 

9.  COTS  equipment  like  video  equipment  can  be  pur¬ 
chased  by  the  USAF  by  taking  advantage  of  past  experi¬ 
ence  with  contracts  for  COTS  computers. 

10.  More  COTS  systems  should  be  bought  only  if  the 
systems  have  had  a  history  of  success  in  the  commercial 
market . 

11.  COTS  are  suitable  for  applications  such  as  train¬ 
ing  missions  but  not  suitable  for  combat. 

12.  The  USAF  does  not  have  to  keep  up  with  drawings  or 
engineering  designs.  Since  COTS  technology  is  advanc¬ 
ing  rapidly,  acquisition  time  is  faster,  and  there  is 
an  existing  economy  of  scale,  the  net  result  in  greater 
savings  than  developed  programs. 

Question  14:  Are  there  any  other  advantages/disadvan- 

tages  'that  should  be  considered  when  buying  COTS?  Three  of 
the  17  managers  remained  neutral  on  this  question.  The  list 
of  advantages  mentioned  by  12  of  the  14  managers  are  listed 
below  (some  answers  overlapped): 

1.  Initial  purchases  of  COTS  allow  follow-on  sole 
source  acquisitions. 

2.  Ruggedized  COTS  puts  the  government  in  a  better  po¬ 
sition  than  with  a  MIL-SPEC,  system. 

3.  The  USAF  saves  time  because  COTS  systems  have  al¬ 
ready  been  developed  with  established  parts  networks. 
The  program  does  not  have  to  wait  for  R&D  efforts. 

4.  COTS  systems  that  have  been  used  in  the  market 
place  have  proven  reliability. 

5.  COTS  systems  are  easier  to  buy  than  MIL-SPEC  sys¬ 
tems  . 

6.  Buying  COTS  at  a  centralized  government,  program  of¬ 
fice  allows  all  participating  agencies  to  benefit  in 
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the  savings  as  a  result  of  economies  of  scale.  Also, 
using  one  CLS  contract  to  support  COTS  systems  for 
multiple  government  agencies  reduces  administrative 
costs . 

7.  COTS  systems  are  easier  to  support  than  MIL-SPEC 
systems . 

8.  Buying  COTS  allows  the  USAF  to  get  new  technology 
fast.  The  USAF  can  afford  to  replace  systems  more  of¬ 
ten  because  they  cost  less. 

The  list  of  disadvantages  mentioned  by  ten  of  the  14 
managers  are  listed  below  (some  answers  overlapped): 

1.  Provisioning  communications  systems  is  not  cost 
effective.  Technology  in  the  communications  equipment 
arena  is  moving  too  rapidly.  By  the  time  we  get  a  sys¬ 
tem  fielded,  it  has  become  obsolete. 

2.  Buying  from  the  lowest  bidder  could  easily  result 
in  a  lack  of  worldwide  product  support.  When  a  small¬ 
er  company  is  required  to  build  spares  to  support  the 
USAF’s  worldwide  mission,  the  firm  may  be  forced  to  go 
out  of  business  because  the  workload  is  too  big. 

3.  The  USAF  needs  a  better  method  to  track  part  num¬ 
bers  for  COTS  spares. 

4.  The  USAF  must  strike  a  balance  between  too  much  or 
too  little  support  for  COTS  systems  to  stay  in  budget. 
This  may  compromise  mission  accomplishment. 

5.  The  USAF  must  pay  much  higher  costs  for  modified 
COTS  systems  (such  as  paint  schemes,  special  attach¬ 
ments,  and  requirements  to  meet  other  special  stan¬ 
dards)  . 

6.  When  the  government  interfaces  COTS  equipment  into 
GFE,  performance  standards  of  the  COTS  may  be  compro¬ 
mised  . 

7.  Some  government  planners  may  falsely  assume  that 
the  savings  from  less  developmental  costs  for  COTS  sys¬ 
tems  will  become  available  for  other  programs.  R&D 
funding  can  not  feasibly  be  used  for  other  purposes. 

8.  High  speed  provisioning  for  LRUs  is  needed  for  COTS 
systems. 
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9.  Stronger  consideration  should  be  given  to  CLS  to 
reduce  investment  costs  and  the  time  to  set  up  support. 

10.  USAF  personnel  need  to  get  used  to  COTS  types  of 
manuals  and  training. 

11.  During  the  acquisition  phase  of  a  COTS  program, 
life  cycle  system  management  for  COTS  systems  must  give 
more  consideration  to  potential  users  and  supporters. 

12.  The  USAF  at  AFLC  and  the  Sacramento  ALC  Technical 
Data  division  have  too  many  people  who  are  trained  to 
treat  COTS  systems  like  fully  developed  systems. 

13.  COTS  should  not  be  used  for  combat  uses. 

Question  15:  Vill  manpower  and  budget  cuts  affect  the 

supportabi 1 ity  of  your  system?  How?  Only  one  of  the  COTS 
programs  will  remain  unaffected  by  manpower  or  budget  cuts. 
Thirteen  of  the  remaining  16  programs  will  only  experience 
supportabi 1 ity  problems  from  budget  cuts.  The  primary  rea¬ 
son  given  far  problems  stemming  only  from  budget  cuts  is 
because  either  organic  capability  allows  cross-utilization 
of  maintenance  personnel  on  the  system,  or  the  CLS  contrac¬ 
tor  is  only  affected  by  budget  cuts  and  not  manpower  cuts. 
Comments  from  the  managers  of  these  13  programs  are  listed 
below  (some  overlapping  occurred) : 

1.  The  USAF  will  be  forced  to  go  back  to  organic  sup¬ 
port  at  a  higher  cost, 

2.  Cross-utilization  of  organic  maintenance  staff  will 
overcome  the  effects  from  manpower  cuts. 

3.  Budget  cuts  will  require  the  USAF  to  cut  spares 
buys . 

4.  The  USAF  will  cut  flying  hours  for  the  program. 

5.  Fewer  systems  can  be  acquired  which  will  result  in 
a  further  backlog  of  requirements  to  be  purchased. 
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This  means  older  systems  will  require  additional  main¬ 
tenance  upkeep  costs. 

6.  The  USAF  just  place  a  two  year  moratorium  on  any 
additional  systems.  Additional  cuts  will  require  cut¬ 
backs  on  delivery  orders  for  FY  1990. 

7.  The  system’s  availability  will  decrease  because  the 
budget  cuts  will  force  the  CLS  contractor  to  spend  more 
time  on  other  COTS  systems  covered  by  this  multiple  CLS 
contract . 

8.  Since  the  system  has  not  been  fully  installed,  bud¬ 
get  cuts  will  delay  the  final  completion  date  (has 
slipped  three  times  already). 

9.  Going  to  organic  support  from  CLS  will  be  disaster- 
ous  because  the  USAF/DoD  can  not  replicate  the  know¬ 
ledge  level  of  the  CLS  contract  personnel. 

10.  Some  budget  cuts  are  not  felt  yet  because  some 
cuts  in  other  programs  have  decreased  the  mission  capa¬ 
bility. 

The  remaining  three  COTS  system  will  be  affected  by 
manpower  and  budget  cuts.  The  managers’  comments  follow: 

1.  The  program  will  revert  to  CLS  which  will  drive 
support  costs  upward.  The  system  is  vital  command  and 
control  equipment.  Eventually,  other  lower  priority 
systems  will  be  cut  back  to  sustain  this  programs’  full 
mission  capability. 

2.  After  the  remaining  three  and  one  half  years  of  the 
five  year  warrantee  ends,  budget  cuts  for  spares  will 
require  the  USAF  to  salvage  systems.  Manpower  cuts  may 
eventually  result  in  additional)  units  going  to  salvage 
(for  lack  of  technical  capability). 

3.  The  USAF  developed  the  system  in  phases.  Funding 
shorts  will  force  the  USAF  to  end  the  current  installa¬ 
tion  phase  prematurely. 


Conclusion 

The  data  collected  from  the  telephone  interviews  allow 
the  reader  to  ascertain  if  the  Investigative  Questions  in 
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Section  I  have  been  answered.  The  questions  are  reprinted 
with  succeeding  answers. 

Question  1:  What  impact  does  the  new  acquisition  in¬ 

itiatives  created  by  the  Defense  Acquisition  Improvement  Act 
of  1986  have  on  the  current  logistics  planning  process  for 
Air  Force  COTS  system?  Constructive  answers  to  questions  1 
and  2  by  the  telephone  interviewees  demonstrated  the  ques¬ 
tionnaire  had  answered  this  question.  The  USAF  has  contrib¬ 
uted  to  buying  more  commercial  systems  for  DoD  missions  in 
the  CONUS  and  around  the  world  since  the  1986  Act.  The  mis¬ 
sions  include  administrative  and  operational  support  from 
the  President  down  to  military  field  units.  Only  a  few  of 
the  programs  in  this  study  were  strictly  COTS  hardware.  The 
USAF  made  modif ications  to  COTS  systems  for  TEMPEST  require¬ 
ments,  paint  schemes,  software  requirements,  and  other  in¬ 
stallation  criteria.  However,  significant  savings  were 
achieved  where  COTS  hardware  (with  no  modif icat ions)  were 
incorporated  into  existing  systems. 

Question  2:  How  have  Air  Force  logisticians  adapted  to 

shorter  acquisition  cycles  for  COTS  systems  and  equipment? 
Constructive  answers  to  questions  3  and  5  by  the  telephone 
interviewees  demonstrated  the  questionnaire  had  answered 
this  question.  Acquisition  and  logistics  support  contracts 
included  flexible  language  to  buy  the  equipment  with  life¬ 
time  C.LS  or  escape  clauses  that  allowed  organic  support  in 
the  future.  Using  CLS  sped  the  fielding  time  of  the  COTS 
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programs  especially  when  the  vendors  (or  subcontractors)  had 
highly  developed  support  networks.  When  the  USAF  had  to 
provision  a  COTS  program,  the  provisioning  process  had  to  be 
accelerated  so  spares  could  reach  the  field  at  the  same  time 
the  equipment  arrived.  Most  COTS  programs  used  commercially 
available  manuals  to  prevent  delays  normally  associated  with 
writing  MIL-SPEC  technical  orders. 

Question  3:  What  creative  techniques  have  logisticians 

used  to  protect  the  Government's  <DoD  and  U.S.  Air  Force) 
operations  from  COTS  systems  that  become  prematurely  obsole¬ 
scent  and  retired  for  use  by  the  Air  Force?  Constructive 
answers  to  questions  6,  8,  9,  and  12  by  the  telephone  inter¬ 

viewees  demonstrated  the  questionnaire  had  answered  this 
question.'  Approximately  one  third  of  the  COTS  programs  in 
this  research  had  little  or  no  risk  from  early  obsolescence 
because  the  USAF  required  prime  contractors  to  integrate 
COTS  hardware  into  existing  government  owned  systems.  The 
risk  was  avoided  also  by  requiring  the  follow-on  CL3  con¬ 
tractor  to  be  fully  responsible  for  spares  and  the  system 
configuration  for  the  length  of  the  contract.  Contractual 
language  for  some  systems  required  the  vendor  to  notify  the 
USAF  within  six  months  if  the  company  was  discontinuing 
production  or  support  of  the  COTS  system.  This  allowed  the 
USAF  to  decide  whether  to  buy  the  designs  or  to  transfer  the 
manufacturer' s  support  to  third-party  vendors. 
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In  some  cases,  the  USAF  expected  the  useful  life  of  the 
COTS  system  not  to  exceed  a  designated  life  span  (such  as 
seven  or  ten  years) .  Thus,  support  requirements  could  be 
planned  accurately  until  the  system  was  programmed  for  dis¬ 
position.  There  was  a  trend  to  have  the  USAF  buy  spares 
during  the  initial  acquisition  to  protect  the  USAF  from 
shortages  in  the  market.  Another  concern  suggested  buying 
more  technical  data  with  the  acquisition  contract,  but.  this 
belief  was  not  prevalent  among  the  managers.  Another  sug¬ 
gestion  included  flexibility  in  the  CLS  contracts  to  in¬ 
crease  the  number  of  CLS  personnel  when  the  COTS  system  ex¬ 
panded  its  operation. 

Question  4:  What,  kind  of  Air  Force  missions  are  best 

suited  to  use  and  support  COTS  equipment?  Constructive  an- 
wers  to  questions  13,  14,  and  15  by  the  telephone  inter¬ 

viewees  demonstrated  the  questionnaire  had  answered  this 
question.  Suggested  systems  for  COTS  candidacy  included 
electronic  equipment,  computers,  test  equipment,  mobile 
construction  equipment,  general  purpose  vehicles,  small 
business-type  aircraft,  video  equipment,  and  equipment 
suited  for  the  classroom  (not  to  include  military  trainers' . 
Systems  considered  not  suitable  for  COTS  are  hardware  in¬ 
tended  for  combat  uses  or  any  equipment  that  requires  modi¬ 
fications.  No  consensus  was  agreed  upon  for  the  level  of 
modifications.  However,  at  least  two  managers  recommended 
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no  system  should  be  considered  for  COTS  if  the  USAF  is 
considering  plans  to  modify  the  commercial  equipment. 

Question  5-.  What  have  Air  Force  acquisition  and  logis¬ 
tics  managers  done  to  maximize  the  benefits  of  COTS  systems 
and  to  minimize  any  other  risks  associated  with  buying  and 
supporting  these  systems?  Constructive  answers  to  questions 
7,  10,  and  11  by  the  telephone  interviewees  demonstrated  the 

questionnaire  had  answered  this  question.  Most  of  the  pro¬ 
grams  used  flexible  contracts  to  minimize  the  risk  for  sup¬ 
porting  and  buying  COTS  equipment.  Some  contracts  also  had 
flexibility  built-in  to  allow  different  types  of  training 
for  both  government  and  CLS  personnel.  The  flexible  train¬ 
ing  methods  allowed  the  USAF  to  adapt  to  changing  require¬ 
ments  throughout  the  life  of  the  systems.  Occasionally,  the 
USAF  had  to  adapt  to  unusual  packaging,  handling,  storage, 
and  transportation  (PHS&T)  requirements  to  prevent  damage  to 
COTS  equipment.  CLS  contractors  were  held  fully  responsible 
for  PHS&T  problems.  The  acquisition  and  CLS  contracts  for 
COTS  systems  were  the  keys  to  achieving  successfxil  results. 

Lessons  learned  by  these  managers  and  recommendations 
for  further  research  will  continue  in  Section  VI. 
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V I .  Lessons  Learned  and  Recommendations 


I ntroduct i on 

This  section  will  present  the  lessons  learned  by  the 
logistics  managers  who  supported  the  17  COTS  programs  in 
this  research  study.  The  research  study  will  end  with  rec¬ 
ommendations  for  areas  of  improvement  and  further  study. 


Lessons  Learned 


1.  When  the  acquisition  time  for  COTS  systems  is 
shorter  than  the  provisioning  process,  USAF  planners  must 
streamline  the  provisioning  process  so  spares  can  be  located 
in  the  field  at  the  same  time  the  new  systems  arrive, 

2.  When  large  COTS  systems  (such  as  computers/te le- 
phone  switches)  are  integrated  with  MIL-SPEC  equipment,  USAF 
managers  follow  a  more  traditional  development  process.  The 
COTS  system  chosen  for  this  application  is  composed  of 
state-of-the-art  technology,  but  comes  from  name  brand  ver- 
dors  with  a  large/established  commercial  market.  Small  ven¬ 
dors  are  avoided  because  the  USAF’ s  large  scale  buying  and 
worldwide  support  requirements  may  over  tax  these  weaker 
companies  that  have  small  scale  operations. 

3.  USAF  planners  have  competed  maintenance  support  for 
some  COTS  systems  between  local  contractors  and  typical  go¬ 
vernment  organizations  to  save  support  costs.  This  tech¬ 
nique  is  used  for  systems  that  have  a  large  pre-existing 
vendor/f actory  trained  support  network  within  the  CONUS  (or 
worldwide  > . 

4.  USAF/government  planners  are  getting  smarter  about 
buying  COTS  systems  with  full  support  (CLS) .  To  lower  the 
cost  of  this  support,  the  CLS  contracts  give  the  USAF  the 
flexibility  to  choose  cheaper  levels  of  CLS  for  bases  with 
less  rigorous  support  requirements. 

5.  The  USAF  is  getting  smarter  with  CLS  contracts  by 
hold  the  CLS  contractor  responsible  for:  1)  critical  spares 
availability,  2)  system,  mission  effectiveness  rates,  and  3> 
configuration  control. 

6.  The  USAF  avoids  mandating  training  for  CLS  contrac¬ 
tor  personnel  to  lower  training  support  costs.  However,  the 
contracts  may  have  monetary  penalty  clauses  against  the 
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contractor  if  the  COTS  system  fails  to  operate  at  a  desired 
effectiveness  level.  Therefore,  CLS  personnel  must  be 
qualified/trained  by  the  CLS  contractor  to  meet  the  USAF’s 
requirements . 

7.  When  the  life  of  a  COTS  system  is  longer  than  ten 
to  20  years,  USAF  planners  may  prove  that  organic  logistics 
support  may  be  less  expensive  than  CLS.  Usually,  COTS  sys¬ 
tems  with  longer  life  expectancies  have  static  core  designs 
and  operate  in  a  stand  alone  configuration  (rather  than  in- 
tegraged  with  MIL-SPEC  GFE) . 

8.  USAF  planners  who  choose  CLS  for  their  COTS  pro¬ 
grams  are  opting  for  longer  contracts  (greater  than  five 
years)  to  stabilize  long  term  support  costs.  The  longer 
contracts  also  allow  the  USAF  to  retain  the  "corporate  know¬ 
ledge”  of  the  contractor’s  site  personnel. 

9.  Some  USAF  planners  are  taking  the  lead  for  the  DoD 
by  offering  administrative  support  for  COTS  systems.  This 
wider  level  support  allows  for  larger  economies  of  scale 
buying  and  less  administrative  support  costs  per  COTS  pro¬ 
gram. 


10.  Some  acquisition  contracts  for  COTS  systems  are 
offering  USAF  MAJCOMs  and  bases  a  cafeteria  style  variety  of 
products  and  levels  of  support  on  a  single  contract.  This 
variety  allows  the  USAF  to  buy  products  and  support  to  sat¬ 
isfy  many  different  user  requirements. 

11.  USAF  planners  for  COTS  programs  are  requiring 
software/hardware  CLS  contractors  to  subscribe  to  vendor 
services  that  provide  information  about  upgrades  and  changes 
to  the  COTS  systems.  The  USAF  is  giving  more  freedom  to  the 
CLS  contractors  to  choose  the  upgrades  (at  the  contractor’s 
expense).  This  allows  CLS  contractors  to  keep  these  COTS 
systems  operating  at  peak  performance  while  lowering  support 
costs.  Thus,  the  CLS  contractor  could  conceivably  increase 
their  profits  if  newer  technology  upgrades  significantly  re¬ 
duce  support  costs. 

12.  Another  trend  with  acquis' t i on/CLS  contracts  al¬ 
lows  the  USAF/CLS  contractor  to  upgrade  or  ’’refresh”  the 
system  wit  technology  improvements  after  the  system  is  in¬ 
stalled  a.id  operating  in  the  field.  This  feature  gives  the 
USAF  the  chance  to  exchange  older  subsystems  and  end  items 
to  lower  support  costs. 

13.  As  COTS  systems  expand  and  take  on  larger  mis¬ 
sions,  the  USAF  can  add  flexibility  in  the  CLS  contract  with 
a  clause  for  centra 1 /reraot e  maintenance  support.  The  USAF 
can  negotiate  with  the  CLS  contractor  to  include  additional 
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CLS  personnel  as  more  remotes  are  added  to  a  centralized 
system,  or  the  USAF  and  the  CLS  contractor  can  opt  for  a 
lower  effectiveness  level  (especially  good  when  budget  re¬ 
ductions  occur).  Flexible  training  formats  may  also  be  in¬ 
cluded  in  the  contract  language  to  meet  various  training 
requirements  for  USAF/CLS  personnel. 

14.  The  USAF  has  also  spread  CLS  contracts  across  mul 
tiple  COTS  systems  to  reduce  the  impacts  of  budget  short¬ 
falls.  If  the  support  budget  decreases,  the  lower  effec¬ 
tiveness  levels  can  be  renegotiated  with  the  contractor  to 
have  a  lesser  impact  on  the  users’  missions  than  if  the  CLS 
contract  had  been  for  only  one  COTS  system. 

15.  Another  technique  used  to  ease  the  impact  of  bud¬ 
get  shortfalls  is  the  use  of  phased  program  development. 
With  each  phase,  desireable  objectives  are  achieved.  New 
phases  add  more  objectives  until  the  USAF  achieves  the  ulti 
mate  program  objective.  If  budget  costs  are  drastic,  a 
phase  will  be  modified,  extended,  or  terminated  to  prevent 
jeopardizing  the  support  for  earlier  phase (s) . 

16.  Training  videos  can  be  considered  for  bridging 
technology  knowledge  gaps  when  COTS  systems  are  upgraded. 
The  videos  can  serve  as  an  initial  operations  and  mainte¬ 
nance  training  technique  until  formal  training  can  be  ar¬ 
ranged  for  USAF/CLS  personnel. 

17.  Magnetic  media  fs  being  used  to  store,  retrieve, 
update,  and  work  with  commercial  drawings  and  technical  man 
uals.  Coupled  with  USAF/comraercial  vendor  review  commit¬ 
tees,  changes  to  COTS  systems  drawings  and  manuals  can  be 
negotiated  and  changed  much  faster  than  paper  media  methods 

18.  Where  provisioned  spares  are  used,  the  USAF  has 
required  the  COTS  vendor  (in  the  acquisition  contract)  to 
supply  critical  parts  to  any  worldwide  operating  location 
within  24  hours  after  receipt  of  order.  By  coupling  this 
time  requirement  with  equipment  redundancy,  the  USAF  may 
achieve  near  full-proof  reliability  with  a  COTS  system. 

19.  The  USAF  governs  the  baseline  for  provisioned 
spares  in  some  COTS  programs  to  eliminate  the  need  for  site 
surveys  and  to  speed  the  process  to  develop  full  depot  sup¬ 
port  . 


20,  Multiple  vendors  for  some  COTS  programs  are  used 
to  prevent  reliance  on  a  sole  source.  Spreading  these  pur¬ 
chases  across  many  sources  reduces  the  risks  that  a  system 
will  become  insupportable  if  a  vendor  discontinues  support 
or  manufacturing  capability  for  the  system. 
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21.  Customized  paint  is  ordered  for  some  COTS  systems 
to  meet  special  USAF  requirements,  but  the  core  design  of 
the  COTS  system  is  left  original. 

22.  Programs  that  are  especially  good  candidates  for 
COTS  technology  are  those  where  the  vendor  has  established  a 
worldwide  parts  network. 

23.  When  only  a  few  COTS  systems  are  purchased  (such 
as  aircraft  and  mainframe  computers),  lower  levels  of  sup¬ 
port  can  be  considered  when  the  contract  includes  on-site 
factory  technical  representatives  (or  factory  trained  Air 
Force  Engineering  and  Technical  Service  equipment  special¬ 
ists)  .  The  technical  representatives  serve  as  site  experts, 
provide  training  to  CLS/government  personnel,  and  perform 
emergency  maintenance  when  required. 

24.  Depot  logistics  support  or  restoration  to  ’’like- 
new”  conditions  are  not  considered  for  COTS  systems  that  ex¬ 
perience  frequent  configuration  changes  (such  as  vehicles). 
Instead,  the  system  is  scheduled  for  replacement  after  it 
experiences  a  predetermined  number  of  hours/miles/years  of 
operation . 

25.  A  commercial lity  clause  is  used  by  some  COTS  ac¬ 
quisition  contracts  to  insure  the  system  is  established  on 
the  commercial  market  for  more  than  12  months  before  the 
USAF  buys  the  system.  This  prevents  buying  systems  that  do 
not  have  mature  support  networks  in  place. 


Recommendations  for  Further  Improvement 

1.  Do  not  fully  provision  COTS  programs.  Provisioning 
is  expensive,  too  long,  and  limits  the  capability  of  the 
commercial  system. 

2.  Do  not  convert  commercial  manuals  to  MIL-SPEC  tech¬ 
nical  orders.  Teach  USAF  personnel  at  the  organizational 
level  how  to  understand  and  work  with  commercial  manuals. 

3.  Speed/streamline  the  acquisition  process  for  COTS 
systems  by  educating  all  of  the  USAF’ s  personnel  at  the 
system  program  offices  and  ALCs  in  buying  and  supporting 
commercial  systems  and  products  (depart  from  using  MIL-STD 
approaches  for  buying  and  supporting  COTS). 

4.  Buy  all  engineering  (type  III)  drawings  when  the 
COTS  system  is  integrated  with  GFE  (such  as  COMSEC  equip¬ 
ment).  This  will  protect  the  government  from  the  effects  of 
future  changes  that  may  occur  (such  as  the  dynamic  changes 
that  ocurred  in  the  COMSEC/TEMPEST  GFE  during  the  1980s). 


6. 4 


5.  Cut  lower  priority  programs  before  cutting  support 
funding  from  command,  control,  and  communications  (C3>  COTS 
systems . 

6.  Buy  additional  COTS  automatic  test  equipment  (ATE) 
to  stock  ahead  and  speed  fielding  to  USAF/DoD  users. 

7.  Consolidate  many  older  MIL-SPEC  systems  that  have 
diverse  missions  under  single  COTS  program  that  is  more  re¬ 
liable  and  offers  new  advanced  technology. 

8.  Use  extended  warranties  to  support  highly  reliable 
COTS  systems  rather  than  using  CLS  or  converting  to  organic 
logistics  support. 

9.  Use  more  of  the  factory  commercial  manuals  that 
come  with  COTS  systems  to  self-train  competent  operations 
and  maintenance  staff  where  possible. 

10.  When  COTS  systems  are  highly  visible  to  government 
executives,  additional  support  costs  should  be  considered  to 
maintain  these  systems  within  more  stringent  standards  (such 
as  more  hangar  space  for  Leer  jets  that  serve  general  offi¬ 
cers  and  senior  executive  service  civilians). 

11.  The  USAF  should  buy  COTS  systems  in  larger  quan¬ 
tities  (especially  if  the  USAF’s  demand  is  high)  to  enjoy 
larger  economies  of  scale  savings. 

12.  The  USAF  should  not  buy  large  COTS  systems  that 
are  integrated  into  MIL-SPEC  GFE  until  all  USAF  support 
staff  for  the  COTS  program  are  trained  in  commercial  ac¬ 
quisition  and  support  practices. 

13.  The  USAF/government  should  study  the  manufactur¬ 
er’s  war  surge  capability  before  buying  a  COTS  system.  If 
the  USAF/government  were  to  buy  too  many  of  the  COTS  systems 
from  a  company  that  could  not  keep  up  with  a  war  surge,  the 
government  would  be  at  a  severe  disadvantage. 

14.  The  USAF  should  always  be  sure  the  COTS  system  is 
the  most  current  model/version  before  committing  the  funding 
and  delivery  for  the  COTS  program.  If  future  models/ver¬ 
sions  are  imminent,  the  USAF  should  delay  the  purchase  until 
the  most  current  technology  can  be  obtained.  Otherwise,  the 
USAF  should  include  wording  in  the  acquistion  contract  to 
allow  expansion  to  future  upgraded  models/versions  of  the 
COTS  system. 

15.  Ruggedizat ion  for  some  COTS  systems  should  be  con¬ 
sidered  for  severe  duty  environments  instead  of  light  duty 
applications.  The  USAF/DoD  services  may  demand  the 
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additional  ruggedized  features  (if  offered)  to  withstand  the 
extremes  of  weather  and  near  batt lef ie Id- 1 i ke  conditions. 

16.  COTS  should  not  be  used  for  battle  use.  The  re¬ 
quirements  of  the  battlefield  (such  as  extreme  vibration  and 
environmental  pressures  standards)  may  not  be  satisfied  with 
a  COTS  system,  and  could  jeopardize  the  lives  of  our  person¬ 
nel  . 

17.  The  USAF  should  buy  more  COTS  items  with  inter¬ 
changeable  (slide-in)  electronic  circuit  boards  (ECBs)  . 

18.  The  USAF  needs  to  give  more  consideration  to  po¬ 
tential  users  and  supporters  of  COTS  programs. 

Recommendations  for  Further  Research 

The  USAF  needs  additional  research  to  find  COTS  sources 
from  foreign  markets  to  enhance  trade  relationships  with 
countries  that  have  ’’friendly-nation”  status.  For  example, 
one  manager  for  COTS  products  felt  Japanese  made  vehicles 
had  a  proven  record  for  reliability  that  rivalled  U.S.  manu¬ 
factured  vehicles.  Other  foreign  manufactured  technologies 
should  be  found  that  could  enhance  other  USAF  non-combatant 
missions.  The  added  goodwill  from  buying  from  our  friendly 
nations  could  go  a  long  way  to  help  preserve  U.S.  foreign 
relations. 

Research  is  needed  to  find  the  practical  methods  to 
streamline  the  USAF’s  acquisition  and  support  structure  for 
buying  COTS  systems.  Caution  is  needed  when  generalizing 
from  this  research  study  because  only  a  minimal  number  of 
COTS  systems  were  studied,  however,  every  COTS  program  of 
this  study  had  peculiarities  in  their  support  structures. 

The  amount  of  difference  between  COTS  programs  should  not  be 
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discouraging  to  USAF  managers  who  want  to  find  similarities 
between  COTS  products.  There  are  many  similarities  in  the 
acquisition  and  support  contracts  that  may  be  useful  when 
considering  other  COTS  systems.  This  useful  information  may 
be  copied  in  whole  or  in  part  to  other  contracts  to  speed 
the  acquisition  process  for  newer  COTS  programs. 

Additional  research  should  be  conducted  to  identify  all 
COTS  programs  that  have  successfully  satisfied  their  USAF 
mission  requirements  and  have  met  budget  constraints.  By 
identifying  all  of  the  successful  programs,  future  research¬ 
ers  can  develop  higher  levels  of  confidence  from  the  lessons 
learned  by  USAF  managers  who  met  rigorous  budget  con¬ 
straints.  The  apparent  cutbacks  in  military  spending  for 
the  1990s  will  require  austere  planning.  The  lessons 
learned  from  planning  in  austere  times  may  also  lead  future 
USAF  managers  to  satisfy  new  mission  requirements  more  effi¬ 
ciently.  More  efficient  planning  and  buying  methods  will 
allow  the  USAF  to  buy  more  war  fighting  capabilities  with 
the  same  budget. 

The  USAF  should  conduct  further  research  in  the  area  of 
maintenance  support  for  COTS  programs.  This  thesis  research 
did  not  confidently  conclude  from  the  data  that  maintenance 
support  had  improved  for  COTS  programs.  By  collecting  more 
data  on  COTS  programs,  the  USAF  could  avoid  pitfalls  with 
acquisition  and  CLS  contracts  and  improve  maintenance  sup¬ 
port  for  future  COTS  programs. 
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With  the  recent  emphasis  about,  buying  more  commercial 
products  in  the  DoD  and  the  effects  of  shrinking  budgets, 
the  Air  Force  has  taken  a  pro-active  lead  among  the  service 
components  to  focus  on  acquiring  the  latest  technology  di¬ 
rectly  from  the  commercial  market.  For  example,  the  USAF 
has  made  plans  to  reorganize  the  Air  Force  Communications 
Command  at  Scott  AFB,  IL  beginning  1  October  1990  to  put 
more  emphasis  on  buying  and  supporting  high  technology 
communications  equipment/systems  like  COTS  programs. 

Basically,  AFCC' s  reorganization  will  reduce  the 
MAJCOM’s  worldwide  support  structure  to  a  centralized  func¬ 
tional  command.  The  divestiture  will  consist  of  giving  the 
base  communications  and  combat  communications  organizations 
to  the  USAF’s  flying  commands.  The  remnant  of  AFCC  will 
consist  of  a  headquarters  staff,  the  Technical  Information 
Center  <TIC),  and  the  engineering  and  installation  (E&I> 
organizations.  The  centralized  structure  will  focus  on 
standardizing  USAF  communications  systems  and  identifying 
the  latest  technological  improvements  in  communications  sys¬ 
tems  that  may  be  used  by  the  USAF.  Potential  communications 
systems  will  be  fully  evaluated  and  tested  for  areas  such  as 
reliability,  maintainability,  and  quality.  MIL-SPEC  and 
COTS  communications  systems  will  continue  to  be  developed, 
evaluated,  and  installed  by  the  new  AFCC  organization  for 
the  USAF. 
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Appendix:  A 

Interview  Questionnaire  For  Logistics  Support  for 
Commercial  Of f-the-Shelf  U.S.  Air  Force  Equipment 
by  Charles  L.  Clayton 

Sample  Interview  Questionnaire 


In  March  of  1985,  the  Air  Force  Acquisition  Logistics 
Center  (AFALC)  published  a  series  of  lessons  learned  bul¬ 
letins  about  Commercial  Off-The-Shelf  (COTS)  equipment. 

These  bulletins  were  designed  to  assist  Program  Managers, 
Deputy  Program  Managers  for  Logistics,  and  Integrated  Logis¬ 
tics  Support  Managers  in  commercial  equipment  acquisition 
programs.  The  introduction  section  of  the  AFALC  bulletins 
points  out  an  important  critical  area  used  by  logisticians 
who  develop  support  systems  for  COTS  equipment  and  systems: 

’’One  of  the  most  serious  drawbacks  of  COTS  is  the 
government’s  lack  of  configuration  control.  This 
affects  many  areas  in  the  life  cycle  cost  (LCC)  of 
COTS.  It  affects  technical  manuals,  spares  pro¬ 
visioning,  integration  into  systems,  support  equip¬ 
ment  requirements,  calibration  procedures,  and  main¬ 
tainability  to  name  a  few.  Unless  configuration 
control  is  contracted  for,  the  government  has  no 
control . ” 

Configuration  control  is  an  extremely  important  issue  when 
buying  COTS  systems,  but  there  are  other  very  important  is¬ 
sues  to  consider  also  such  as:  training,  support  equipment, 
unverified  technical  orders,  design  interface  concerns,  and 
maintenance  support.  These  critical  areas  become  part  of 
the  overall  complex  logistics  support  process  managers  con¬ 
sider  when  analyzing  the  life  cycle  costs  for  COTS  systems. 
COTS  systems  hold  a  primary  advantage  over  developmental 
items  (MIL-SPEC)  because  much  of  the  analysis  has  already 
been  accomplished  by  the  vendor.  This  reduction  in  analysis 
time  translates  into  significant  cost  savings  to  the  Air 
Force  because  we  do  not  have  to  wait  for  the  developmental 
efforts  as  we  do  with  MIL-SPEC  systems. 

Logistics  support  for  COTS  systems,  however,  may  pre¬ 
sent  our  managers  with  significant  challenges.  Current  li¬ 
terature  on  logistics  support  for  COTS  systems  do  very  lit¬ 
tle  to  assist  Air  Force  managers  because  the  literature  is 
restricted  only  to  single  issues  or  general  ideas  about  how 
to  plan  for  these  systems.  With  this  lack  of  specific 
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guidance,  Air  Force  managers  must  rely  on  past  experience  or 
get  help  from  those  who  have  bought  and  planned  support  for 
COTS  systems. 

The  purpose  of  this  interview  will  be  to  identify  cm — 
rent  trends  among  Air  Force  logisticians  who  deal  with  a  va¬ 
riety  of  COTS  systems  throughout  the  Air  Force  and  to  com¬ 
pile  the  lessons  they  learned  when  buying  COTS  systems. 

Their  answers  will  by  summarized  into  a  specific  list  of 
ideas  and  procedures  used  to  support  the  unique  requirements 
for  COTS  systems.  This  research  effort  will  provide  future 
planners  with  relevant  information  that  will  help  them  to 
buy  COTS  systems. 

The  attached  list  of  questions  will  be  used  as  a  guide 
during  the  phone  interview.  Mr.  Charles  Clayton,  a  graduate 
student  at  the  Air  Force  Institute  of  Technology,  will  be 
conducting  the  interviews  on  your  COTS  system.  The  results 
of  the  interview  will  be  compared  with  other  interviews  to 
develop  a  common  thread  of  management  techniques  or  the  ex¬ 
perts’  lessons  learned  concerning  COTS  systems  they  bought 
and  supported  for  use  in  the  Air  Force.  The  interview  will 
last  approximately  30  minutes. 
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I nterview 


Questionnaire 
On  COTS  Systems 


Interviewer:  _ 

Name 

Location:  _ 

Base 

Tel.  # :  _ 

Program  Name:  _ 

Date : 


Organization 


1.  Describe  your  _ _  COTS  system,  what  does 

it  support,  who  uses  it,  and  name  the  bases  that  use  it? 


2.  Has  this  COTS  system  been  modified  for  government  use, 
or  is  the  system  pure  COTS  purchased  from  the  vendor  as-is 
just  like  the  civilian  sector? 


If  you  answered  yes,  how  is  the  system  modified? 
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3. 


How  is  the 


COTS  system  supported: 


Organizational  Intermediate  Depot 

CLS  _  _  _ 

Organic  _  _  _ 


If  the  COTS  system  is  supported  by  CLS,  is  the  CLS 
planned  for  the  life  of  the  system,  or  is  the  CLS  sub¬ 
ject  to  competitive  negotiation  at  specific  intervals? 


Is  there  more  than  one  CLS  contractor  for  the  system? 

If  so,  are  there  any  discrepancies  as  to  which  contrac¬ 
tor  maintains/repairs  the  item(s)? 


4.  How  did  the  maintenance  support  concept  degrade  or 
improve  for  the  _  COTS  system? 

Vhat  steps  were  required  to  resolve  any  problems? 
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5.  Discuss  the  role  of  commercial  (or  military  type) 
drawings\manuals  for  the  _  COTS  system. 


Are  they  adequate? 


Do  they  get  updated  as  changes  are  made  to  the  equip¬ 
ment? 


What  steps  were  required  to  resolve  any  problems? 


6.  Was  it  necessary  to  integrate  the  _  COTS 

system  into  any  other  pre-existing  systems  or  facilities? 


Vho  performed  the  integration  (prime  contractor,  CLS 
contractor,  or  the  government)? 


Is  the  configuration  unique  to  the  Air  Force? 


What  problems  were  encountered  during  and  after  the  in¬ 
tegration,  and  how  were  they  resolved? 


A.  5 


7.  Vhat  type  of  training  format  is  required? 
Who  provides  it? 


Vho  receives  it? 


Is  it  necessary? 


Is  it  adequate? 

Are  there  any  problems  with  the  training? 


8.  Are  critical  failure  parts  easily  accessible  for  the 
_  COTS  system? 


Vho  provides  the ■ spare  parts? 


Are  there  any  delays  or  problems  in  getting  the  parts 
needed  to  keep  the  system  operational? 


Vhat  steps  were  required  to  resolve  any  problems? 
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9.  Describe  how  the  configuration  management/control  is 

impacted  by  spare  parts  for  the  COTS  _ 

system. 

What  impact  is  created  when  the  conf igurat ion  of  the 
COTS  system  changes? 


Does  the  system  remain  operational  after  the  configura¬ 
tion  changes? 


What  steps  were  required  to  resolve  any  problems? 


10.  Describe  how  your  staff  has  adapted  to  any  config¬ 
uration  changes  with  the  _  COTS  system. 


Vhat  steps  were  required  to  resolve  any  problems? 


11.  Does  your  _  COTS  system  have  any  support 

problems  due  to  improper  packaging,  handling,  storage,  and 
transportation?  Facilities?  Other? 


Vhat  steps  were  required  to  resolve  any  problems? 
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12.  If  you  could  change  anything  about  the  system,  what 
would  you  like  to  do  to  improve  the  logistics  support  for 
the _ COTS  system? 


13.  Would  you  recommend  buying  more  of  these  COTS  systems 
if  you  knew  what  you  know  now,  and  why  or  why  not? 


Would  you  recommend  COTS  for  other  systems?  What  type 
and  why? 


14.  Are  there  any  other  advar  i  ...ges,  ai  sadvantages  that 
should  be  considered  wh:  .i  uuying  COTS? 


15.  Will  manpower  and  budget  cuts  affect  the  support.abi  1  i ty 
of  your  system?  How? 
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Appendix  B:  Glossary 


Acquisition  -  The  act  of  gaining  possession  of  something  or 
to  get  by  one’s  own  efforts  (American  Her i tage : 75 ) . 

Acquisition  Logistics  -  The  process  of  systematically  ident¬ 
ifying  and  assessing  logistics  alternatives,  analyzing 
logistics  alternatives,  analyzing  and  resolving  ILS 
(integrated  logistics  support)  deficiencies,  and  manag¬ 
ing  ILS  throughout  the  acquisition  process  (Department 
of  the  Air  Force  Pamphlet  800-34:1-1). 

Developmental  Item  -  Also  known  as  a  MIL-SPEC  item  (see 
definition  below) 

Integrated  Logistics  Support  -  ILS  is  defined  as  (DoD 
Integrated  Logistics  Support  Guide: 1-1): 

A  disciplined,  unified,  and  iterative  approach  to 
the  management  and  technical  activities  necessary 
to : 


a . 

Define  the  support  for 

a  system 

b. 

Design  for  support  for 

the  system 

c . 

Acquire  the  support  for 

the  system 

d. 

Provide  the  support  for 

the  system 

Life  Cycle  Cost  -  LCC  is  defined  as  (DoD  Integrated  Logis¬ 
tics  Support  Guide: 6-1): 

The  LCC  estimate  is  comprehensive  ...  it  covers 
all  costs  to  the  Government  during  the  system’s 
life  cycle.  Research  and  development,  production, 
operation  and  support,  and  disposal  costs  are  in¬ 
cluded  in  LCC. 

Logistics  Support  Process  -  The  ILS  process  (see  definition 
above)  is  used  to  put  a  system  into  operation  and  to 
support  it  for  its  intended  useful  life. 

Logistics  Support  Analysis  -  LSA  is  defined  as  (DoD  Integra¬ 
ted  Logistics  Support  Guide: 5-1): 

An  analytical  effort  for  influencing  the  design  of 
a  system  and  defining  support  system  requirements 
and  criteria.  The  objective  of  LSA  is  to  ensure 
that  a  systematic,  and  comprehensive  analysis  is 
conducted  on  a  repetitive  basis  through  all  phases 
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of  the  system  life  cycle  in  order  to  satisfy  read 
iness  and  supportabi 1 ity  objectives. 

MIL-SPEC  -  MIL-SPEC  equipment  is  defined  as: 

The  classic  military  approach  to  design  and  construc¬ 
tion:  a  government  design  for  government  use.  The  Go¬ 
vernment  is  financing  the  design  effort,  will  ultimate 
ly  ultimately  own  and  control  the  design,  and  intends 
that  it  be  rugged  enough  to  withstand  battlefield  use. 
The  design  philosophy  and  selection  of  parts  are 
strictly  according  to  military  specifications  and  stan 
dards,  and,  typically,  the  cost  is  high  (Sacramento: 1) 

Nondevelopmental  Item  -  The  U.S.  Congress  defined  nondevel- 
opmental  items  as  follows  (U.S.  Congress: 10  U.S.  Code 
2325): 

(1)  Any  item  of  supply  that  is  available  in  the 
commercial  marketplace; 

(2)  Any  previously  developed  item  of  supply  that 
is  in  use  by  a  department  or  agency  of  the  United 
States,  a  State  or  local  government,  or  a  foreign 
government  with  which  the  United  States  has  a  mu¬ 
tual  defense  cooperation  agreement; 

(3)  Any  item  of  supply  in  paragraphs  (1)  or  (2) 
that  requires  only  minor  modification  in  order  to 
meet  the  requirements  of  the  procuring  agency;  or 

(4)  Any  item  of  supply  that  is  currently  being 
produced  that  does  not  meet  the  requirements  (1), 
(2),  or  (3)  solely  because  the  item- 

a.  Is  not  yet  in  use;  or 

b.  Is  not  yet  available  in  the  commercial 
marketplace . 

Off-the-shelf  (or  COTS)  -  Commercial-off-the-shelf  (COTS) 
items  are  defined  as  a  subset  of  nondevelopmental 
items,  which  do  not  require  development  by  government 
planners.  The  more  accepted  definition  for  COTS  tyne 
equipment  is  as  follows:  ”a  commercial  item  is  an  item 
developed  and  used  for  other  than  government  purposes; 
sold  or  traded  to  the  general  public  in  the  course  of 
normal  business  operations,  and  (ideally)  used  un¬ 
changed  ("off-the-shelf”)  when  acquired  by  the  govern¬ 
ment”  (Sacramento:!). 
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Procurement  -  An  item  obtained  or  acquired  to  bring  about 
a  solution  or  some  effect  (American  Her i tage : 989 ) . 

Provisioning  -  The  provisioning  process  is  defined  as  fol¬ 
lows  (MI L-STD-1388- 1 A > : 

’’The  process  of  determining  and  acquiring  the 
range  and  quantity  of  spares  and  repair  parts,  and 
support  and  test  equipment  required  to  operate  and 
maintain  an  end  item  of  material  for  an  initial 
period  of  service. 
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